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Preface 


Radio spectrum, as an indispensable enabler of wireless communications, is 
becoming a severely scarce resource with the explosive growth of wireless traffic 
and massive connections of devices. Because of the spectrum scarcity problem, 
millimeter-wave band and Tera-Hertz band are being explored for cellular mobile 
communications. However, measurements have shown that the radio spectrum is 
experiencing underutilization due to the adoption of static and exclusive spectrum 
allocation method. It is expected that the spectrum allocation policy will be evolved 
from the fixed manner to dynamic spectrum management (DSM), in order to make 
full use of the radio spectrum. 

The success of DSM, however, attributes not only to the availability of technical 
methodologies, but also to the support from the spectrum policy. Cognitive radio 
(CR) is the state-of-the-art enabling technique for DSM. With CR, an unlicensed/ 
secondary user is able to opportunistically or concurrently access spectrum bands 
owned by the licensed/primary users. On the other hand, blockchain, as an essen- 
tially open and distributed ledger, incentivizes the formulation and secures the 
execution of the policies for DSM. Finally, artificial intelligence (AI) techniques 
help the users observe and interact with the dynamic radio environment, thereby 
improving the efficiency and robustness of CR and blockchain for DSM. 

This book provides a systematic overview of the above three technologies for 
DSM, and reviews several communication systems that use DSM. It is intended for 
a broad range of readers, including the students and the researchers in wireless 
communications, as well as the radio spectrum policymakers. We hope the con- 
cepts, theories and methodologies presented in this book could offer useful refer- 
ences and guidance to the readers. 


Chengdu, China Ying-Chang Liang 
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Chapter 1 A) 
Introduction E 


Abstract Facing the increasing demand of radio spectrum to support the emerging 
wireless services with heavy traffic, massive connections and various quality-of- 
services (QoS) requirements, the management of spectrum becomes unprecedentedly 
challenging nowadays. Given that the traditional fixed spectrum allocation policy 
leads to an inefficient usage of spectrum, the dynamic spectrum management (DSM) 
is proposed as a promising way to mitigate the spectrum scarcity problem. This 
chapter provides an introduction of DSM by firstly discussing its background, then 
presenting the two popular models: the opportunistic spectrum access (OSA) model 
and the concurrent spectrum access (CSA) model. Three main enabling techniques for 
DSM, including the cognitive radio (CR), the blockchain and the artificial intelligence 
(AD are briefly introduced. 


1.1 Background 


Radio spectrum is a natural but limited resource that enables wireless communi- 
cations. The access to the radio spectrum is under the regulation of government 
agencies, such as the Federal Communications Commission (FCC) in the United 
States (US), the Office of Communications (Ofcom) in the United Kingdom (UK), 
and the Infocomm Development Authority (IDA) in Singapore. Conventionally, the 
regulatory authorities adopt the fixed spectrum access (FSA) policy to allocate dif- 
ferent parts of the radio spectrum with certain bandwidth to different services. In 
Singapore, for example, the 1805-1880 MHz band is allocated to GSM-1800, and 
it cannot be accessed by other services at any time. With such static and exclusive 
spectrum allocation policy, only the authorized users, also known as licensed users, 
have the right to utilize the assigned spectrum, and the other users are forbidden 
from accessing the spectrum, no matter whether the assigned spectrum is busy or 
not. Although the FSA can successfully avoid interference among different appli- 
cations and services, it quickly exhausts the radio resource with the proliferation of 
new services and networks, resulting in the spectrum scarcity problem. 

The statistics of spectrum allocation around the world show that the radio spec- 
trum has been almost fully allocated, and the available spectrum for deploying new 
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services is quite limited. The emerging of massive connections of internet-of-things 
(IoT) devices accelerates the crisis of spectrum scarcity. According to the study in 
[1], around 76 GHz spectrum resource is needed for accommodating billions of end 
devices by exclusive occupying the spectrum. Nevertheless, extensive measurements 
conducted worldwide such as US [2], Singapore [3], Germany [4], New Zealand [5] 
and China [6], have revealed that large portions of the allocated radio spectrum are 
underutilized. For instance, in US, the average occupancy over 0-3 GHz radio spec- 
trum at Chicago is 17.4%. This number is even as low as approximately 1% at West 
Virginia. In Singapore, the average occupancy over 80-5850 MHz band is less than 
5%. These findings reveal that the inflexible spectrum allocation policy leads to an 
inefficient utilization of radio spectrum, and strongly contributes to the spectrum 
scarcity problem even more than the physical shortage of the radio spectrum. 


1.2 Dynamic Spectrum Management 


The contradiction between the scarcity of the available spectrum and the underutiliza- 
tion of the allocated spectrum necessitates a paradigm shift from the inefficient FSA 
to the flexible and high-efficient spectrum access. In this context, dynamic spectrum 
management (DSM) has been proposed and recognized as an effective approach to 
mitigate the spectrum scarcity problem. It has been foreseen that by using DSM, the 
spectrum requirement for deploying the billions of internet-of-things (IoT) devices 
can be sharply reduced from 76 to 19 GHz [7]. In DSM, the users without license, 
also known as secondary users (SUs), can access the spectrum of authorized users, 
also known as primary users (PUs), if the primary spectrum is idle, or can even share 
the primary spectrum provided that the services of the PUs can be properly protected. 
By doing so, the SUs are able to gain transmission opportunity without requiring ded- 
icated spectrum. This spectrum access policy is known as dynamic spectrum access 
(DSA). According to the way of coexistence between PUs and SUs, there are two 
basic DSA models: (1) The opportunistic spectrum access (OSA) model and (2) the 
concurrent spectrum access (CSA) model. 


1.2.1 Opportunistic Spectrum Access 


A spectrum usage in the OSA model is illustrated in Fig. 1.1. Due to the sporadic 
nature of the PU transmission, there are time slots, frequency bands or spatial direc- 
tions at which the PU is inactive. The frequency bands on which the PUs are inactive 
are referred to as spectrum holes. Once one or multiple spectrum holes are detected, 
the SUs can temporarily access the primary spectrum without interfering the PUs by 
configuring their carrier frequency, bandwidth and modulation scheme to transmit on 
the spectrum holes. When the PUs become active, the SUs have to cease their trans- 
mission and vacate from the current spectrum. To enable the operation of the OSA, 
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Fig. 1.1 An illustration of Spectrum used Spectrum 
spectrum usage in the OSA Frequency by the PUS Holes 
model t 


Time 


the SU needs to obtain the accurate information of spectrum holes, so that the quality 
of services (QoS) of the PUs can be protected. Two factors determine the method 
that the SU can adopt to detect the spectrum holes. One factor is the predictability of 
the PU’s presence and absence, and the other factor is whether the primary system 
can actively provide the information of the spectrum usage. Accordingly, there are 
basically two methods which can be adopted by SUs to detect spectrum holes. 


(1) Geolocation Database 


If the PU’s activity is regular and highly predictable, the geographical and temporal 
usage of spectrum can be recorded in a geolocation database to provide the accurate 
status of the primary spectrum. For accessing the primary spectrum without inter- 
fering the PUs, an SU firstly obtains its own geographic coordinates by its available 
positioning system, and then checks the geolocation database for a list of bands on 
which the PUs are inactive in the SU’s location. The geolocation database approach 
is suitable for the case when the PUs’ presence and absence are highly predictable, 
and the spectrum usage information can be publicized for achieving a highly effi- 
cient utilization of spectrum [8—10]. For example, in the final rules set by the FCC 
for unlicensed access over TV bands, the geolocation database is the only approach 
that is adopted by unlicensed devices for protecting the incumbent TV broadcasting 
services [11]. Nevertheless, for other services, such as cellular communications, the 
activities of users are difficult to be predicted and there is lack of incentive for the PUs 
to provide their spectrum usage, especially when the primary and secondary services 
belong to different operators. In this case, the geolocation database is inapplicable. 


(2) Spectrum Sensing 


Without a geolocation database, an SU can carry out spectrum sensing periodically 
or consistently to monitor the primary spectrum and detect the spectrum holes. When 
there are multiple SUs, cooperative spectrum sensing can be applied to improve the 
sensing accuracy [12-17]. Different from the previous method where the accurate 
spectrum usage information is recorded in the geolocation database, the spectrum 
sensing is essentially a signal detection technique, which could be imperfect due to 
the presence of noise and channel impairment, such as small-scale fading and large- 
scale shadowing [18]. To measure the performance of spectrum sensing, two main 


4 1 Introduction 


metrics, i.e., the probability of detection and the probability of false alarm, are used. 
The former one is the probability of detecting the PU as being present when the PU 
is active indeed. Thus, it describes the degree of protection to the PUs, i.e., a higher 
probability of detection provides a better protection to the PUs. The latter one is the 
probability of detecting the PU as being present when the PU is actually inactive. 
Therefore, it can be regarded as an indication of exploration to the spectrum access 
potential. A lower probability of false alarm indicates more transmission opportuni- 
ties can be utilized by the SUs, and thus better SU performance, such as throughput, 
can be achieved. To this end, a good design of spectrum sensing should have a high 
probability of detection but low probability of false alarm. However, these two met- 
rics are generally conflicting with each other. Given a spectrum sensing scheme, the 
improvement of probability of detection is achieved at the expense of increasing 
probability of false alarm, which leads to less spectrum access opportunities for the 
SUs. In another word, a better protection to the PUs is at the expense of the degra- 
dation of the SU’s performance. To improve the performance of spectrum sensing, 
there has been a lot of work on designing different detection schemes or allowing 
multiple SUs to cooperatively perform spectrum sensing [12-17]. 

It is worth noting that the spectrum sensing is an essential tool for enabling DSA 
and deserves continued development from the research communities. Although spec- 
trum sensing is not mandatory for the unlicensed access over TV white space, the 
current standards developed such as IEEE 802.22 and ECMA 392 still use a combi- 
nation of geolocation database and spectrum sensing [19-21]. In some literatures, the 
OSA model is also referred to as spectrum overlay [22], or interweave paradigm [23]. 


1.2.2 Concurrent Spectrum Access 


A typical CSA model is shown in Fig. 1.2, where the SU and the PU are transmitting 
on the same primary spectrum concurrently. In this type of DSA, the secondary trans- 
mitter (SU-Tx) inevitably produces interference to the primary receiver (PU-Rx). 
Thus, to enable the operation of the CSA, the SU-Tx needs to predict the interfer- 
ence level at the PU-Rx caused by its own transmission, and limit the interference 
to an acceptable level for the purpose of protecting the PU service. In practice, a 
communication system is usually designed to be able to tolerate a certain amount of 
interference. For example, a user in a code-division multiple access (CDMA) based 
third-generation (3G) cellular network can tolerate interference from other users and 
compensate the degradation of signal-to-interference-plus-noise ratio (SINR) via the 
embedded inner-loop power control. Such level of tolerable interference is known 
as interference temperature, which is also referred to, in some literatures, as inter- 
ference margin. The concurrent transmission of SU-Tx is allowed only when the 
interference received by the PU-Tx is no larger than the interference temperature. 
Therefore, different from the OSA model where the geolocation database or spec- 
trum sensing is used for detecting spectrum holes, interference control is critical for 
CSA to protect the PU services. 
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Fig. 1.2 An illustration of 
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The protection of the PU is mathematically formulated as an interference power 
constraint. A basic interference power constraint indicates that the instantaneous 
interference power received by PU-Rx is no larger than the interference temperature. 
Such a formulation requires that the SU-Tx has the information of the interference 
temperature provided by PU-Rx and the channel state information (CSI) from SU-Tx 
to PU-Rx, also known as cross channel state information (C-CSI), to quantify the 
actual interference received by the PU-Rx. Variants of the basic interference power 
constraint result in different performance of the secondary system. For example, 
the average interference power constraint gives better secondary throughput than 
the peak interference power constraint [24, 25]. This is because that the former 
constraint is less stringent, and in some fading states it allows the interference exceed 
the interference temperature. Furthermore, if there are multiple SUs, the secondary 
system can exploit the multiuser diversity (MUD) to improve secondary capacity by 
choosing the SU with best receive quality and least interference to the PU-Rx to be 
active for transmitting or receiving. The MUD of sharing a single frequency band 
was carefully studied in [26-29]. To benefit from the interference diversity or MUD, 
the CSI from SU-Tx to SU-Rx and SU-Tx to PU-Rx should be known by the SU-Tx. 

Exploiting the primary system information can offer more sharing opportunities. 
In [30], rate loss constraint was proposed to restrict the performance degradation of 
the PU due to the secondary transmission. To formulate this constraint, not only the 
C-CSI, but also the CSI from PU-Tx to PU-Rx and the transmit power of PU-Tx 
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are required [31]. Without direct cooperation between the primary and secondary 
systems, the SU-Tx can trigger the power adaptation of primary system by inten- 
tionally sending the probing signal with a high power [32, 33]. To tackle the strong 
interference, PU-Tx will increase its transmit power which can be heard by the SU- 
Rx. Then, the secondary system deduces the interference temperature provided by 
the primary system and estimates the C-CSI, which is the critical information for 
secondary system to successfully share the primary spectrum. 

It is worth noting that, similar to OSA, the protection to the primary system and 
the secondary throughput are contradictory with each other. A stringent protection 
requirement of the primary system leads to a low secondary throughput. Therefore, 
making good use of the interference temperature is the way to optimize the per- 
formance of the secondary system in the CSA model. In some literatures, the CSA 
model is also referred to as spectrum underlay [33]. 

The comparison of OSA and CSA is summarized in Table 1.1. It can be seen 
that when the PU is off, the SU can transmit with its maximum power based on 
OSA model. However, when the PU is on, the SU can still transmit by regulating 
its transmit power based on the CSA model, rather than keep silent according to the 
OSA model. Such a hybrid spectrum access model combines the benefits of OSA 
and CSA, which gains higher spectrum utilization. Moreover, in the aforementioned 
OSA and CSA models, the PUs have higher priority than the SUs, and thus should be 
protected. Such a DSA is also known as hierarchical access model, since the priorities 
of accessing the spectrum are different based on whether the users are licensed or 
not. In the hierarchical access model, since the PUs are usually legacy users, the 
cooperation between the primary and secondary systems are unavailable, and only 
the SUs are responsible to carry out spectrum detection or interference control. In 
some cases, the primary system is willing to lease its temporarily unused spectrum 
to the SUs by receiving the leasing fee, which is an incentive for the PUs to provide 
certain form of cooperation. In the literatures, the DSA model in which all of the 
users have equal priorities to access the spectrum has also received lots of attention, 
such as license-shared access (LSA) and spectrum sharing in unlicensed band [34— 
36]. Although there is no cap of interference introduced to the others, in this DSA 
model, each user has to take the responsibility to protect the others or keep fairness 
in accessing the spectrum. 


Table 1.1 Comparison of OSA and CSA 


OSA CSA 
Whether SU is always on? No Yes 
How to learn the environment? | Spectrum sensing, geolocation | Channel estimation, 
database interference prediction 
Techniques to protect PU No transmission when PU is on | Interference control 
Measurement of PU protection | Detection probability Interference temperature, 
performance loss margin 
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1.3 Cognitive Radio for Dynamic Spectrum Management 


Cognitive radio (CR) has been widely recognized as the key technology to enable 
DSA. A CR refers to an intelligent radio system that can dynamically and 
autonomously adapt its transmission strategies, including carrier frequency, band- 
width, transmit power, antenna beam or modulation scheme, etc., based on the inter- 
action with the surrounding environment and its awareness of its internal states (e.g., 
hardware and software architectures, spectrum use policy, user needs, etc.) to achieve 
the best performance. Such reconfiguration capability is realized by software-defined 
radio (SDR) processor with which the transmission strategies is adjusted by com- 
puter software. Moreover, CR is also built with cognition which allows it to observe 
the environment through sensing, to analyse and process the observed information 
through learning, and to decide the best transmission strategy through reasoning. 
Although most of the existing CR researches to date have been focusing on the 
exploration and realization of cognitive capability to facilitate the DSA, the very 
recent research has been done to explore more potential inherent in the CR technol- 
ogy by artificial intelligence (AI). 

A typical cognitive cycle for a CR is shown in Fig. 1.3. An SU with CR capabil- 
ity is required to periodically or consistently observe the environment to obtain the 
information such as spectrum holes in OSA or interference temperature and C-CSI in 
CSA. Based on the collected information, it determines the best operational param- 
eters to optimize its own performance subject to the protection to the PUs and then 
reconfigures its system accordingly. The information collected over time can also 
be used to analyse the radio environment, such as the traffic statistics and channel 
fading statistics, so that the CR device can learn to perform better in future dynamic 
adaptation. 


Signal 
Transmission 


RF Stimuli 


Adapt Observe 
(Reconfiguration) (Sensing) 


Spedtrum Holes, 
| State Information Channel State Information 
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Decide Channel Fading Statistics Analyze 
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Fig. 1.3 The cognitive cycle for CR 
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Although enabling DSA with CR is a technical issue which involves multidisci- 
plinary efforts from various research communities, such as signal processing, infor- 
mation theory, communications, computer networking, and machine learning [37], its 
realization also largely depends on the willingness of regulators to open the spectrum 
for unlicensed access. Fortunately, over the past decades, we have seen worldwide 
efforts from regulatory bodies on eliminating regulatory barriers to facilitate DSA. 
For example, in the US, the FCC set forth a few proposals for removing unnecessary 
regulations that inhibit the development of secondary spectrum markets in Novem- 
ber, 2000 [38]. Later, in December 2003, the FCC recognized the importance of CR 
and promoted the use of it for improving spectrum utilization [39]. In May 2004, 
the FCC issued a notice of proposed rulemaking (NPRM) that proposes to allow 
the unlicensed devices (both fixed and personal/portable) to reuse the temporarily 
unused spectrum of TV channels, i.e., TV white space [40], and the rules for such 
unlicensed use were finalized in September 2010 [11]. In the national broadband plan 
released in March 2010, the FCC also indicated its intention to enable more flexible 
access of spectrum for unlicensed and opportunistic uses [41]. The TV white space is 
considered to be very promising for a wide range of potential applications due to its 
favorable propagation characteristics [11], and hence it has also drawn attention from 
other regulators worldwide. For example, in the UK, the Ofcom proposed to allow 
licence-exempt CR devices to operate over the spectrum freed up due to analog to dig- 
ital TV switchover in the statement of the Digital Dividend Review Project released 
in December, 2007 [42]. In Singapore, the IDA has also recognized the potential 
of TV white space technology and conducted trials for testing the feasibility and 
developing regulatory framework to facilitate it [43]. 

Besides regulators’ efforts on spectrum “deregulation”, various standardization 
communities have also been actively working on developing industrial standards 
that expedite the commercialization of CR-based applications. Following the FCC’s 
NPRM in May 2004, the IEEE 802.22 working group was formed in November 2004 
that aims to develop the first international standard that utilizes TV white space based 
on CR [44, 45]. The standard specifies an air interface (both physical (PHY) layer and 
medium access control (MAC) layer) for a wireless regional area network (WRAN), 
which is designed to provide wireless broadband access for rural or suburban areas 
for licensed-exempt fixed devices through secondary opportunistic access over the 
VHF/UHF TV broadcast bands between 54 and 862 MHz. The finalized version has 
been published in July, 2011 [20]. The first international CR standard on the use of 
personal/portable devices over TV White Spaces is ECMA 392 [46]. The first edition 
of the standard was finalized in December, 2009 by ECMA International based on the 
draft specification contributed from cognitive networking alliance (CogNeA) [46]. It 
specifies an air interface as well as a MUX sublayer for higher layer protocols [21], 
which is targeted for in-home, in-building and neighborhood-area applications in 
urban areas [46]. Other standards based on CR include IEEE 802.1 laf, IEEE 802.19, 
IEEE SCC 41 (previously known as IEEE 1900), as well as the Third Generation 
Partnership Project (3GPP) LTE Release 13 which introduces the licensed assisted 
access (LAA) to utilize the 5GHz unlicensed bands for the operation of LTE [9, 
47-49]. 
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1.4 Blockchain for Dynamic Spectrum Management 


The past decade has witnessed the burst of blockchain, which is essentially an open 
and distributed ledger. Cryptocurrency, notably represented by bitcoin [50], is one of 
the most successful applications of blockchain. The price for one bitcoin started at 
$0.30 in the beginning of 2011 and reached to the peak at $19,783.06 on 17 December 
2017, which reveals the optimism of the financial industry in it. Facebook, one of the 
world biggest technology company, announced its own cryptocurrency project Libra 
in June 2019. Besides the cryptocurrency, with its salient characteristics, blockchain 
has many uses including financial services, smart contracts, and IoT. According to 
a report from Tractica, a market intelligence firm, enterprise blockchain revenue 
will reach $19.9 Billion by 2025 [51]. Moreover, blockchain is believed to bring 
new opportunities to improve the efficiency and to reduce the cost in the dynamic 
spectrum management. 

Blockchain is essentially an open and distributed ledger, in which transactions 
are securely recorded in blocks. In the current block, a unique pointer determined 
by transactions in the previous block is recorded. In this way, blocks are chained 
chronologically and tamper-evident, i.e., tampering any transaction stored in a pre- 
vious block can be detected efficiently. The transactions initiated by one node are 
broadcast to other nodes, and a consensus algorithm is used to decide which node 
is authorized to validate the new block by appending it to the blockchain. With the 
decentralized validation and record mechanism, blockchain becomes transparent, 
verifiable and robust against single point of failures. Based on the level of decen- 
tralization, blockchain can be categorized into public blockchain, private blockchain 
and consortium blockchain. A public blockchain can be verified and accessed by all 
nodes in the network, while a private blockchain or a consortium blockchain can 
only be maintained by the permissioned nodes. 

A smart contract, supported by the blockchain technology, is a self-executable 
contract with its clauses being transformed to programming scripts and stored in a 
transaction. When such a transaction is stored in the blockchain, the smart contract is 
allocated with a unique address, through which nodes in the network can access and 
interact with it. A smart contract can be triggered when the pre-defined conditions 
are satisfied or when nodes send transactions to its address. Once triggered, the smart 
contract will be executed in a prescribed and deterministic manner. Specifically, the 
same input, i.e., the transaction sent to the smart contract, will derive the same 
output. Using a smart contract, dispute between the nodes about transactions is 
eliminated since that node can identify its execution outcome of the smart contract 
by accessing it. 

Blockchain has been investigated to support various applications of IoT. As a 
decentralization ledger, blockchain can help integrate the heterogeneous IoT devices 
and securely store the massive data produced by them. For instance, with data such 
as how, where and when the different processes of production are completed being 
immutably recorded in a blockchain and traceable to consumers, the quality of prod- 
ucts can be guaranteed. Other uses of blockchain in IoT include smart manufacturing, 


10 1 Introduction 


smart grid and healthcare [52]. Moreover, blockchain is also applied to manage the 
mobile edge computing resources to support the IoT devices with limited computa- 
tion capacity [53]. 

Recently, telecommunication regulator bodies have paid much attention to apply 
blockchain technology to improve the quality of services, such as telephone num- 
ber management and spectrum management. In the UK, Ofcom initiated a project 
to explore how blockchain can be used to manage telephone numbers [54]. Specifi- 
cally, a decentralized database could be established using the blockchain technology, 
to improve the customer experience when moving a number between the service 
providers, to reduce the regulatory costs and to prevent the nuisance calls and fraud. 
On the other hand, blockchain is also believed to bring new opportunities to spectrum 
management. According to a recent speech by FCC commissioner Jessica Rosen- 
worcel, blockchain might be used to monitor and manage the spectrum resources to 
reduce the administration cost and speed the process of spectrum auction [55]. It is 
also stated that with the transparency of blockchain, the real-time spectrum usage 
recorded in it can be accessible by any interested user. Thus, the spectrum utilization 
efficiency can be further improved by dynamically allocating the spectrum bands 
according to the dynamic demands submitted by users using blockchain. 

Researchers have been investigating the application of blockchain in spectrum 
management. In [56], applications of blockchain to spectrum management are dis- 
cussed by pairing different modes of spectrum sharing with different types of 
blockchains. In [57], authors provide the benefits of applying blockchain to the Citi- 
zens Broadband Radio Service (CBRS) spectrum sharing scheme. In [58], dynamic 
spectrum access enabled by spectrum auctions is secured by the use of blockchain. 
In [59], smart contract supported by blockchain is used to intermediate the spec- 
trum sensing service, provided by sensors, to the secondary users for opportunistic 
spectrum access. In [60], dynamic spectrum access is enabled by the combination of 
cryptocurrency which is supported by blockchain, and auction mechanism, to pro- 
vide an effective incentive mechanism for cooperative sensing and a fair method to 
allocate the collaboratively obtained spectrum access opportunity. 

Essentially, there is a need to derive some basic principles to investigate why and 
how applying blockchain to the dynamic spectrum management can be beneficial. 
Specifically, we can use blockchain (1) as a secure database; (2) to establish a self- 
organized spectrum market. Moreover, the challenges such as how to deploy the 
blockchain network over the cognitive radio network should be also addressed. 


e Blockchain as A Secure Database: The conventional geolocation database for 
the usage of spectrum bands, such as TV white spaces, can be achieved by the 
blockchain with increased security, decentralization and transparency. Moreover, 
other information such as historical sensing results, outcomes of spectrum auctions 
and access records can also be stored in the blockchain. 

e Self-organized Spectrum Market: A self-organized spectrum market is desired with 
its improved efficiency and reduced cost in administration compared to relying on 
a centralized authority to manage the spectrum resources. With the combination of 
smart contract, cryptocurrency, and the cryptographic algorithms for identity and 
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transaction verification, blockchain can be used to establish a self-organized spec- 
trum market. For example, traditional spectrum auctions usually need a trusted 
authority to verify the authentication of the users, decide the winning user and 
settle the payment process. With blockchain, specifically, with the smart contract, 
spectrum auctions can be held in a secure, automatic and uncontroversial way. 
Moreover, with the security provided by blockchain, transactions can be made 
between users without any trust in each other. Thus, the high bar to obtain the 
spectrum resources can be reduced. Besides the spectrum access right, other prop- 
erty/services related to the spectrum management, such as the spectrum sensing, 
can also be traded between users by smart contracts. 

e Deployment of Blockchain: The consensus algorithm, such as Proof of Work 
(PoW), through which a new block containing transactions can be added to the 
blockchain, is usually computationally intensive. Thus, it is needed to consider 
the limited computation capacity and battery of mobile users when deploying the 
blockchain over the traditional cognitive radio network. Based on this, we will pro- 
vide three ways, including (1) enabling users to directly maintain a blockchain, (2) 
using a dedicated blockchain maintained by a third-party authority, and (3) allow 
users to simply offload the computation task to edge computing service providers 
(ECSPs) while keeping the verification and validation authority to themselves. 


In summary, the blockchain technologies have been believed to bring new 
opportunities to the dynamic spectrum management, to hopefully improve the decen- 
tralization, security and autonomy, and reduce the administration cost. While chal- 
lenges such as the energy consumption, the deployment and design of blockchain 
network over the traditional cognitive radio network should also be investigated. 
With a detailed and systematic investigation on blockchain technologies to dynamic 
spectrum management, which will be given in Chap. 5, we believe the directions will 
be more clear for the readers interested in the relevant researches. 


1.5 Artificial Intelligence for Dynamic Spectrum 
Management 


AI, which is a discipline to construct intelligent machine agents, has received increas- 
ing attention. AlphaGo, the most famous AI agent, has beaten many professional 
human players in Go games since 2015 [61]. In 2017, AlphaGo Master, the succes- 
sor of Alpha Go, even defeated Ke Jie, who was the world No.1 Go player at the 
time. The concept of AI was proposed by John McCarthy in 1956, and its primary 
goal is to enable the machine agent to perform complex tasks by learning from the 
environment [62]. Nowadays, AI has become one of the hottest topic both in the 
academia and in the industry, and it is even believed to lead the development in the 
information age [63]. Specifically, the AI techniques have been successfully applied 
to many fields such as face and speech recognition. Moreover, AI techniques have 
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shown potentials in the dynamic spectrum management, to improve the utilization 
of the increasingly congested spectrum. 

Machine learning (ML), as the core technique of AI, has been greatly developed 
both in theories and applications [64]. Generally, there are three branches of the ML 
techniques. 


Statistical Machine Learning: With the training data obtained and the task known, 
statistical machine learning (SML) first constructs a statistical model, and then 
trains the parameters in the model. After that, when new data arrives, the agent 
is able to perform the task based on the learnt model. The commonly used SML 
methods include support vector machine (SVM), K-nearest neighbor (KNN), K- 
means and Gaussian mixture model (GMM). 

Deep Learning: Based on the artificial neural network (ANN), which has a strong 
ability to approximate functions, deep learning (DL) is normally used in the classi- 
fication tasks. Compared with the traditional ANN, DL is distinctive with its deeper 
architecture. Moreover, its performance is improved by designing and adopting 
ad-hoc neural networks for data of different types, such as convolutional neural 
network (CNN) for image data and recurrent neural network (RNN) for temporal 
data. 

Deep Reinforcement Learning: Aiming to solve the sequential decision-making 
tasks, deep reinforcement learning (DRL) allows the agent to maximize its long- 
term profit by continuously interacting with the environments. The commonly 
used DRL methods are deep Q-network (DQN), double deep Q-network (DDQN), 
asynchronous advantage actor-critic (A3C) and deep deterministic policy gradient 
(DDPG). 


The application of the AI techniques especially the above ML techniques to the 
next-generation communications networks has attracted a significant amount of atten- 
tion of the telecommunication regulators. In the U.S., the FCC hosted a forum on AI 
and machine learning for 5G on Nov 30, 2018. In this forum, the panelists concluded 
that the AI techniques could improve network operations and would become a criti- 
cal component in the next-generation wireless networks [65]. It is stated by A. Pai, 
the chairman of the FCC, that AI has the potentials to construct smarter communica- 
tions networks and to improve the efficiency of the spectrum utilization [66]. In the 
UK, Ofcom also recognized AI and machine learning as powerful technologies to 
support 5G application scenarios such as ultra-reliable low-latency communications 
(URLLCs) [67]. 

Motivated by the superiority of AI, many research organizations have been inves- 
tigating on the applications of AI techniques to the dynamic spectrum management 
[68]. The defense advanced research projects agency (DARPA) in the U.S. has held 
a 3-year grand competition called “spectrum collaboration challenge” (SC2) since 
2017 [69]. The main objective of the SC2 is to imbue wireless communications with 
AI and machine learning so that intelligent strategies can be developed to optimize 
the usage of wireless spectrum resource in real time. Recent works from national 
institute of standards and technology (NIST) in the U.S. show that the Al-based 
method greatly outperforms the traditional methods on spectrum sensing [70]. 
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Using the machine learning and AI techniques, the model-based schemes in the 
traditional DSM can be transformed into data-driven ones. In this way, DSM becomes 
more flexible and efficient. Specifically, we summarize the benefits of applying AI 
techniques to the DSM as follows. 


e Autonomous Feature Extraction: Without pre-designing and extracting the expert 
features as in the traditional schemes, AI-based schemes can automatically extract 
the features from data. In this way, the agent can achieve its objective without any 
prior knowledge or assumptions of the wireless network environments. 

e Robustness to the Dynamic Environment: With periodic re-training, the perfor- 
mance of the data-driven approaches would not be significantly affected by the 
change of the radio environment, resulting in the robustness to the environment. 

e Decentralized Implementation: With the help of AI techniques, the spectrum man- 
agement mechanisms can be achieved in a decentralized manner. This means 
that the central controller is no longer needed and each device can independently 
and adaptively obtain its required spectrum resource. Moreover, in the distributed 
implementation, each device is allowed to only use its local observations of the 
radio environment to make decisions. Thus, massive message exchange and sig- 
naling overheads to acquire the global observations can be avoided. 

e Reduced Complexity: In most Al-based schemes, management policies can be 
directly obtained and repeatedly used after the convergence. In this way, the 
repeated computation for obtaining the policies in the traditional schemes is 
avoided. Additionally, the direct use of raw environmental data in AI-based 
approaches eliminates the complexity of designing expert features and can even 
achieve better performance. 


However, there exist some challenges to achieve the AI-based DSM schemes. For 
example, it is needed for an Al-based scheme to differentiate the importance of data 
of different types in the radio environment. On that basis, the AI-based scheme is 
more likely to extract features useful for its objective. Moreover, since there exist 
huge computation overheads in the training of the existing AI techniques, how to 
accelerate computation to reduce the latency and the expense is also a matter of 
concern. 

In summary, it is believed that the DSM would be achieved in a more efficient, 
robust, flexible way by applying AI and machine learning techniques. However, chal- 
lenges in the implementations of AI-based DSM schemes should also be addressed. 
A detailed and systematic investigation on machine learning technologies and their 
applications to the DSM will be presented in Chap. 6. 


1.6 Outline of the Book 


DSM has been recognized as an effective way to improve the efficiency of spectrum 
utilization. In this book, three enabling techniques to DSM are introduced, including 
CR, blockchain and AI. 
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Chapters 2—4 discuss the CR techniques. Specifically, the Chap.2 focuses on 
the CR for OSA. We start with a brief introduction on the OSA model and the 
functionality of sensing-access design at PHY and MAC layers. Then three classic 
sensing-access design problems are introduced, namely, sensing-throughput trade- 
off, spectrum sensing scheduling, and sequential spectrum sensing. Furthermore, 
existing works on sensing-access design are reviewed. Finally, the application of the 
OSA to operating LTE in unlicensed band (LTE-U) is discussed. 

Chapter 3 is especially used for discussing the spectrum sensing, which is the 
critical technique for OSA. We first provide the fundamental theories on spectrum 
sensing from the optimal likelihood ratio test perspective. Then, we review the clas- 
sical spectrum sensing methods including Bayesian method, robust hypothesis test, 
energy detection, matched filtering detection, and cyclostationary detection. After 
that, we discuss the robustness of the classical methods and review techniques that 
can enhance the sensing reliability under hostile environment. Finally, we discuss 
the cooperative sensing that uses data fusion or decision fusion from multiple senors 
to enhance the sensing performance. 

Chapter 4 focuses on the CR for CSA. We start with an introduction on the chal- 
lenges existing in the CSA model. Then, the basic single-antenna CSA is presented 
and the optimal transmit power design under different types of power constraints is 
discussed. Furthermore, the multi-antenna CSA is presented and the channel informa- 
tion acquisition and transceiver beamforming are discussed. After that, the transmit 
and receive design for CR multiple access channel and broadcasting channel are pre- 
sented, which is followed by the discussion of the robust design for the multi-antenna 
CSA. Finally, the application of CSA to operating LTE in the legacy licensed band, 
as known as spectrum refarming, is provided. 

Chapter5 presents the applications of blockchain techniques to support DSM. 
Generally, the use of the blockchain technologies can achieve the improvement of 
the decentralization and security, as well as the reduction in the administration cost. 
We investigate the basic principles of applying the blockchain technologies to spec- 
trum management and practical implementation of blockchain over the CR network. 
Moreover, the recent literatures are reviewed, and the challenges and the future direc- 
tions are also discussed. 

Chapter 6 presents the applications of AI techniques to support DSM. With the help 
of AI techniques, the spectrum management would be achieved in a more flexible 
and efficient way, meanwhile obtaining performance improvement. This chapter 
starts with the basic principle of AI. Then, a review of ML techniques, including the 
statistical ML, deep learning and reinforcement learning is presented. After that, the 
recent applications of AI techniques in spectrum sensing, signal classification and 
dynamic spectrum access are discussed. 
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Chapter 2 A) 
Opportunistic Spectrum Access get 


Abstract Opportunistic spectrum access (OSA) model is one of the most widely 
used model for dynamic spectrum access. Spectrum sensing is the enabling func- 
tion for OSA. The inability for a secondary user (SU) to perform spectrum sensing 
and spectrum access at the same time requires a joint design of sensing and access 
strategies to maximize SUs’ own desire for transmission while ensuring sufficient 
protection to the primary users (PUs). This chapter starts with a brief introduction 
on the opportunistic spectrum access model and the functionality of sensing-access 
design at PHY and MAC layers. Then three classic sensing-access design problems 
are introduced, namely, sensing-throughput tradeoff, spectrum sensing scheduling, 
and sequential spectrum sensing. Finally, the application of the opportunistic spec- 
trum access to operating LTE in unlicensed band (LTE-U) is discussed. 


2.1 Introduction 


The opportunistic spectrum access (OSA) model, also referred to as interweave 
paradigm in [1] or spectrum overlay in [2], is probably the most appealing model 
for unlicensed/secondary users to access the radio spectrum. In this model, the sec- 
ondary users (SUs) opportunistically access the spectrum bands of primary users 
(PUs) which are temporally unused. Enabling the unlicensed use of the spectrum 
while guaranteeing the priority of licensed users, the OSA model has received great 
attention from both the research and the regulatory organizations. 

By definition, before transmission, the SUs in the OSA model need to know the 
busy/idle status of the spectrum bands which they are interested in. With such knowl- 
edge, the SUs can access the unused spectrum bands of the PUs, i.e., the spectrum 
holes, or the spectrum white space so that the PUs’ QoS will not be degraded. As 
introduced in Chap. 1, such knowledge can be acquired using two approaches, includ- 
ing the use of a geolocation database and spectrum sensing technique. The former 
approach can be applied when the PU’s spectrum usage is highly predictable [3, 4] 
and the PUs are willing to publicize the spectrum usage, possibly for improving the 
spectrum utilization [5]. However, when the spectrum usage of the PUs might not 
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Fig. 2.1 Key functions of the PHY and MAC layer in the OSA model 


be predictable or the PUs are unwilling to share such information, spectrum sensing 
becomes a critical way to detect the available spectrum which enables the operation 
of the OSA model. 

Spectrum sensing based OSA design has gone through a thriving development 
from the academia. One batch of works have focused on improving the accuracy of 
spectrum sensing, while others have focused on the coordination of spectrum sensing 
and access, i.e., the sensing-access design. As essentially a signal detection technique, 
spectrum sensing might lead to incorrect results due to the noise uncertainty and the 
channel effects such as multipath fading and shadowing. The accuracy of spectrum 
sensing is however crucial in the detection of spectrum holes and the protection of 
PUs. Thus, a lot of works have focused on the design of efficient detection algorithms 
or the collaboration of SUs for the diversity gain [6-11]. The detailed introduction 
on spectrum sensing techniques will be given in Chap.3, while in this chapter, we 
will discuss the other important aspect of OSA design which is the sensing-access 
design. The sensing-access structure of the OSA reveals that the spectrum access 
is largely dependent on the results of spectrum sensing. Moreover, the optimization 
of the performance on spectrum sensing and access might be conflicting with some 
practical concerns such as the limited computational capability of the SUs, which 
gives rise to the tradeoff design between the spectrum sensing and access. 

In Fig. 2.1, we illustrate the key functions for the physical (PHY) and medium 
access control (MAC) layers of the CR networks (CRNs). In the PHY layer, spec- 
trum sensing enables the SUs to detect the spectrum holes, while the access control 
optimizes the transceiver design with respect to the carrier frequency, the modulation 
and coding scheme, etc. In the MAC layer, there are mainly two functions, includ- 
ing the sensing scheduling and access scheduling. The former determines when, on 
which channel, how long and how frequently the spectrum sensing should be imple- 
mented, while the latter governs the access of multiple users to the detected spectrum 
holes. A coordinator of the two functions, called as the sensing-access coordinator, 
is established. In the following sections, we will investigate three classic problems 
in the sensing-access design by first presenting their basic ideas and concerns, and 
then reviewing the existing literatures on solving them. 
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2.2 Sensing-Throughput Tradeoff 


Due to the half duplex operation of a transceiver, an SU cannot perform spectrum 
sensing and access at the same time. As a result, it has to alternate between sensing 
operation and access operation within a data frame. Assuming that the spectrum 
sensing is performed periodically in each frame, the frame structure for the SU is 
illustrated in Fig.2.2. Denote t as the spectrum sensing time and T as the frame 
length. Then the time duration left for potential spectrum access is thus T — t. Intu- 
itively, with longer sensing time, the accuracy of spectrum sensing can be improved 
and it is higher chance that the status of the spectrum can be correctly detected. How- 
ever, this reduces the time left for spectrum access and thus affects the throughput of 
the SU. Therefore, there is a tradeoff between spectrum sensing and throughput. This 
problem of sensing-throughput tradeoff is investigated in [12]. In the following, the 
basic formulation of such a problem is first presented. Extension to the case when 
cooperative spectrum sensing is employed is then followed. 


2.2.1 Basic Formulation 


The performance of spectrum sensing is characterized by two performance metrics, 
namely, the probability of false alarm Pr (i.e., the probability of detecting the PU 
as being present when the PU is actually absent) and the probability of detection Py 
(i.e. the probability of detecting the PU as being present when the PU is present). The 
decision whether to access the spectrum depends on the result of spectrum sensing. 
There are two scenarios when the SU could access the spectrum. 


e When the PU is not present and no false alarm is generated by spectrum sensing. 
e When the PU is present but is not detected by spectrum sensing. 


The average throughput of the secondary network can be calculated by taking into 
consideration the achievable throughput for both scenarios 


R = Ro + Rı (2.1) 
Fig. 2.2 Frame structure for 
periodic spectrum sensing Frame n Frame n+1 Frame n+2 
Sensing Access 
m T >< T-r > 
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where Ro is the amount of the throughput contributed by the first scenario whereas 
R; is the one contributed by the second scenario. Denote P(H{o) as the probability 
that the PU is absent. Denote the Co and C; as the throughout of the SU when it 
continuously transmits in the first scenario and second scenario, respectively. Then, 
Ro and R; can be expressed as follows 


T =< 
Role, 1) = PH) — 


CoC — P(e, T)) (2.2) 
T-T 
Rı(e, t) =U — P(Ho)) C0 — Pale, T)) (2.3) 


where e€ is the threshold of energy detection for spectrum sensing. Since both the 
threshold e and the sensing time t affect the accuracy of spectrum sensing, Py and 
P, are functions of (€, t) and so are Ro and Rj. 

Note that different from the first scenario, in the second scenario, the SU transmits 
in the presence of the PU. Hence, in general, we have Cp > Cı. Furthermore, it is 
typically more beneficial to explore the spectrum that is underutilized, for example, 
when P(Ho) = 0.5. Therefore, it can safely assume that Ro dominates the overall 
throughput R. Hence, R(e€, tT) © Ro(€, T). 

The problem of sensing-throughput tradeoff is to optimize the spectrum sensing 
parameters to maximize the achievable throughput of the SU subject to that the PU 
is sufficiently protected. Mathematically, the problem can be expressed as 


T-T 
max R(e,t) © P(Ho) 7 Co(1 — Pp (e€, T)) (2.4a) 
s.t. Py(e,t) > Py (2.4b) 
0<t<T, (2.4c) 


where P; is the target probability of detection. It has been proved in [12] that the 
above optimization achieves its optimality when the constraint (2.4b) is satisfied with 
equality. 

Note that the above formulation highly depends on the two performance metrics 
of spectrum sensing, i.e., Py and Ps. The former can be considered as an indication 
to the level of protection to the PU since a higher probability of detection reduces the 
chance that the SU accesses the spectrum over which the PU is operating; whereas 
the latter is related to the amount of transmission opportunities for the SUs since 
the lower the false alarm, the better that the SU can reuse the spectrum. These two 
metrics in the form of P4 and 1 — Py are conflicting with each other. For example, 
for a given detection scheme, an increase in the probability of detection can improve 
the protection to the PU; however, this is achieved at the expense of increasing 
probability of false alarm which leads to decreasing spectrum access opportunities 
to the SU. 
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By using energy detection and setting Py = Pz, the probability of false alarm can 
be expressed as [12] 


Pia) =Q (2y FIA (Pa) + Veh) (2.5) 


where y is the received signal-to-noise ratio (SNR) of the primary signal, t is the 
sensing time and f, is the sampling rate. 

Then the above optimization problem reduces to an optimization problem with 
only a single variable t with the objective function given as follows 


R(x) © OPH) (1- =) (1-@(V2v FIA (Pi) + Vehy)) 26 


It has been proved in [12] that under certain regulating assumptions on the form and 
distribution of the noise and the primary and secondary signals there exists an optimal 
sensing time that maximizes the achievable throughput of the secondary network. 
Consider the scenario when P(Ho) = 0.8, T = 100ms and f, = 6MHz. The 
probability of false alarm Py and the normalized achievable throughput R / Co P (Ho) 
of the secondary network are plotted with respect to the spectrum sensing time t in 
Figs. 2.3 and 2.4, respectively, under different received SNRs of the primary signal 
y. As expected, it can be seen from Fig. 2.3 that with longer sensing time, the quality 
of spectrum sensing improves and thus the probability of false alarm decreases. 
However, this leads to a reduction in the available spectrum access time. Overall, it 
can be observed from Fig. 2.4 that there is an optimal sensing time which maximizes 
the achievable throughput. Furthermore, it can be observed that when y decreases 


Probability of false alarm Py 


y= —10 dB 
=y AdB 
= ae y= —14 dB 
> Z= a = 5 
> ae 2 2.5 


Sensing time 7 (ms) 


Fig. 2.3 Probability of false alarm Py versus sensing time t under different received SNRs y of 
the primary signal 
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Fig. 2.4 Normalized achievable throughput R/(Co P(Ho)) versus sensing time t under different 
received SNRs y of the primary signal 


which indicates more stringent spectrum sensing requirement, the SU has to devote 
more time for spectrum sensing in order to protect the PU which leads increased 
optimal spectrum sensing time and reduced maximum achievable throughput. 


2.2.2 Cooperative Spectrum Sensing 


The above formulation considers the case where the result of spectrum sensing is 
determined by a single SU. When there are multiple nearby SUs, spectrum sensing 
can be improved by combining the sensing result of these users. Thus, the quality 
of spectrum sensing does not only depend on the detection threshold € and the 
sensing time T but also the way how the individual sensing results are combined, i.e., 
the fusion rule. In [13], the basic formulation of the sensing-throughput problem is 
extended to the case that cooperative spectrum sensing is used. 

Assume that there are N SUs participating in cooperative spectrum sensing and 
reporting their individual sensing result to the fusion center. Consider that k-out-of- 
N fusion rule [11] is used by which the channel is detected to be busy if there are at 
least k out of N users that detect so. The quality of spectrum sensing thus depends 
on the parameter k of the fusion rule. The overall probability of false alarm and the 
probability of detection are given by 


N 


N ; zj 
Pret.) =Y e Jee t)i (1— P(e, t))” (2.7) 


i=k 
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and 
N 


N P ; 
Pa (€, t, k) = 5 e ) Pate ry (1 — Pale, N , (2.8) 


i=k 


respectively. 
Then the basic formulation in (2.4) can be revised to the following problem 


T-—Tt 
max R(e, t, k) ~ P(A) 7 Co (1 =P eT, k)) (2.9a) 
s.t. Pa(e, t, k) > Py (2.9b) 
O0<t<T (2.9c) 
O<k<N. (2.9d) 


Similar to the basic formulation, it is proved in [14] that optimality is achieved with 
(2.9b) satisfied in equality. Then any fixed k value, the value of P(e, t) for the 
individual SU, denoted by P4, that satisfies (2.9b) in equality can be found. For any 
given value of P4, P r is related to P, by (2.5). Then the above optimization problem 
can be reduced to an optimization problem of only two variables (t, k). In [13], an 
iterative algorithm is proposed to compute the optimal value of (t, k). 


2.3 Spectrum Sensing Scheduling 


In the sensing-throughput tradeoff problem, spectrum sensing time is optimized by 
considering a fixed frame duration. In the above formulation, it implicitly assumes 
that the status of the PU remains unchanged throughout the entire frame. In other 
words, it implies that the SU has be in synchronization with the PU’s frame. This may 
not be easy to achieve if the PU refuses to cooperate to provide such synchronization 
information. In this case, for a periodic spectrum sensing scheme, the duration of the 
frame, which determines how frequent spectrum sensing is scheduled, also affects 
the achievable throughput of the secondary network. 

Intuitively, with a fixed sensing time, the longer the frame duration, the more the 
effective transmission time. This potentially leads to higher throughput. However, 
when the frame duration is long, there is higher chance that the PU’s status will 
change during an SU’s transmission. This may result in collision in the middle of the 
secondary transmission if the primary user becomes active. The throughput of the 
SU, in this case, will suffer. Therefore, the duration of the frame needs to be optimized 
to balanced the tradeoff between the PU protection and the SU performance. Such a 
problem is investigated in [15] and is presented in the following. 

As mentioned in Sect.2.2.1, there are two scenarios when the SU accesses the 
spectrum. Similar to the treatment in the sensing-throughput tradeoff problem, only 
the achievable throughput of the first scenario is considered since it is the dominating 
factor. 
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Fig. 2.5 The considered scenario 


Consider the first scenario when the primary user is not active during spectrum 
sensing as shown in Fig. 2.5. Assume that the primary user has an exponential on- 
off traffic model in which both the durations of the active and inactive periods are 
exponential distributed with the mean duration of jz; and uo, respectively. Due to 
the memoryless property of the exponential distribution, without loss of generality, 
the end of the sensing slot can be considered as the starting time t = 0. Denote the 
instance that the primary user becomes active by t. Then the duration of time during 
which collision occurs is a random variable, which can be expressed as 


T—t—-t,O0<t<T-—-t 


x(t) = G IST (2.10) 


Based on this, the average time that collision occurs in the frame can be calculated 
as follows 


(2.11) 
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Then the normalized achievable throughput (normalized by P (Ho)(1 — Py)Co) of 
the SU in this scenario is 
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Next, the collision probability for the PU will be derived. The average collision 
time within each active period of the primary user can be calculated as 


x = x 
PrO<t<T-—T} 1 — exp(—") 
0 


y= (2.14) 
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Then the collision probability can be expressed as 


y 1 T-T 
P? (T) = — = Ho 
Hı Mı \1—exp (- r) 
Ho 


(2.15) 


The objective is to find the optimal frame duration to maximize the normalized 
achievable throughput subject to that the collision probability of the primary user is 
kept below a limit. Mathematically, it is expressed as 


max A(T) = £ (: — exp (-—)) (2.16) 
T T Ho 

s.t. P?(T) < PP (2.17) 

T>t (2.18) 


Setting the derivative of R(T) to zero, the stationary point of the objective function 


can be found as 
T, = — mo (wa (-e (-2**))) (2.19) 
Ho 
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Fig. 2.6 The normalized achievable throughput and the PU’s collision probability at different frame 
durations T 


28 2 Opportunistic Spectrum Access 


where W_.,(x) represents the negative branch of the Lambert’s W function which 
solves the equation w exp(w) = x for w < —1.If P? (T,) < P? and T, > t, then T, 
is the optimal frame duration. 

Consider the scenario with the average inactive duration of uo = 650 ms, the 
average active duration of uı = 352 ms, the spectrum sensing time of t = 1 ms 
and the target collision probability of PZ = 0.1. Figure2.6 shows the normalized 
achievable throughput and the PU’s collision probability, respectively, with respect 
to the frame duration. It can be seen from the figure that in this scenario there is a 
unique frame duration that maximizes the normalized achievable throughput and at 
the same time satisfies PU’s collision probability constraint. 


2.4 Sequential Spectrum Sensing 


Periodic spectrum sensing has been considered in the preceding two sections. In such 
a sensing framework, if a channel is sensed to be busy, the SU has to wait until the 
next frame to sense the same channel or another channel to identify any spectrum 
opportunity. This could result in delay in accessing the spectrum. Another approach 
that is fundamentally different from periodic spectrum sensing is the sequential spec- 
trum sensing. In such a sensing framework, the SU will sequentially sense a number 
of channels without any additional waiting period in between before it decides which 
channel to transmit over. In this case, the SU can dynamically determine how many 
channels should be sensed before a transmission. This approach allows the SU to 
explore diversity in the occupancy among different licensed channels. Hence, in case 
that one channel is sensed to be busy, the SU can quickly identify a spectrum oppor- 
tunity by continuing to sense other channels. Furthermore, it allows the SU to explore 
diversity in the secondary channel fading statistics so that the SU can possibly take 
advantage of a better channel to maximize its own desire. 

Clearly, when more channels are sensed, there is higher chance to identify a chan- 
nel with higher throughput. However, this may result in more energy and time wasted 
in spectrum sensing. A tradeoff has to be balanced between throughput and energy 
consumption. In [16], the sensing-access design for sequential spectrum sensing is 
investigated from an energy-efficiency perspective. In particular, the paper designs 
the sensing policy which determines when to stop sensing and start transmission, 
the access policy which determines how much power is used upon transmission and 
the sense order that determines which channel to sense next if the current channel 
is given up for transmission to maximize the overall energy efficiency of the entire 
sequential spectrum sensing process. In the following, the energy-efficient sensing- 
access design with a fixed sensing order is first described and then extended to the 
case when sensing order is optimized. 
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2.4.1 Given Sensing Order 


In [16], the authors consider the sequential spectrum sensing framework under which 
the SU can sequentially sense a maximum number of K channels of bandwidth B 
each. An example of the considered sequential channel sensing process when the 
sensing order is given according to the logical indices of the channels is illustrated 
in Fig. 2.7. For each channel, e.g., channel k, the SU will perform spectrum sensing 
to find if channel k is busy or idle, i.e., the status ô of channel k with 6, = 1 and 
ôk = 0 representing channel k is busy and idle, respectively. If channel k is sensed 
to be busy, the SU will continue to sense the next channel. If channel k is sensed to 
be idle, the SU will continue to perform channel estimation to determine the channel 
gain h; and then decide whether to select a power level to transmit over this channel 
for a period of 7; or to continue to sense the next channel. 

Under such a sequential spectrum sensing framework, a decision has to be made 
after sensing each channel before the SU decides to access a channel. At maximum, 
K decisions have to be made. Such a process can be modeled as a K -stage stochastic 
sequential decision-making problem, which consists the following basic components: 


e State: Due to the imperfection of spectrum sensing, only an observation ô about the 
true PU channel status ô% is available. The system state in this case is characterized 
by sk = (x, hg). It is assumed that hg = 0 when br = | since channel estimation 
will not be carried out in this case. An additional state s, = T is introduced to 
denote that the sequential spectrum sensing process has been terminated once the 
transmission has started. 

e Decision: At each stage k, after observing the system state są, a decision ug has 
to be made. When channel k is sensed to be busy, i.e., s = (1, 0), the only deci- 
sion available is uz = C, where C denotes continuing to sense the next channel. 
However, when channel k is sensed to be idle, the SU has to decide whether to 
continue to sense the next channel, i.e., uy = C or choose a transmit power level, 
i.e., Ux = pı to transmit, the latter of which leads to the termination state, i.e., 
Sk Ss SSK HT. 

e Cost functions: Since energy efficiency is the ratio between the throughput (i.e., 
average number of bits transmitted) and the average energy consumption, two 
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Fig. 2.7 An illustration of the sequential spectrum sensing process in [16] 
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cost functions are defined, i.e., one for the throughput and the other for the energy 
consumption. 
First, some notations are introduced. Denote r? and r as the number of bits that 
can be transmitted over channel k when it is truly idle and truly busy, respectively. 
Furthermore, 

r? = TB log, (1 + SNR;/T) (2.20) 


where SN R, represents the SNR received at the SU-Rx, and I is considered as 
the SNR gap to channel capacity. The received SNR can be further defined as 


Kk pi 


SN Rehe, p) = (2.21) 


where px captures the propagation loss, ı is the link margin compensating the 
hardware process variation and imperfection, and ø? is the noise power at the 
receiver front end. Moreover, denote 6; as the probability that channel k is idle, 
Le., Ok = Pr(d, = 0), Pex as the probability of false alarm for channel k, Pik as 
the target probability of detection for channel k. 

When channel k is sensed to be busy, the throughput is gf (sx, uz) = 0. Otherwise, 
it is defined as 


BE (Se, Mk) = Ez ja [re] = @ere + (1 ori © org (2.22) 


OUP) 
7 A A= Pfk) HA0) Pak) i 
ôk = 0. The approximation is due to the fact that P% ~ | and y > rl [12]. 
The energy consumption at stage k is defined as 


where a, = is the posterior probability of ô = 0 given 


0, ifs, =T 
8E (Sk, uk) = 4 Tps + (ap; + Pe), if sk AF and ug = p; (2.23) 
TDs, otherwise 


where p, is the sensing power, p, is the power consumed in various transceiver 
electronic circuits excluding the power amplifier (PA), a = &/¢, € the peak-to- 
average ratio of the PA, and ¢ is the drain efficiency of the PA. 


The objective of the energy-efficient sequential spectrum sensing is to find a 
sequence of functions @ = {u (s1), ..., Hg (Sx)} mapping each state sg into a control 
Ukg = [x (5;), Such that the energy efficiency of the entire sequential spectrum sensing 
process is maximized. Mathematically, this can be expressed as 


{DK af tO] 
r [EK ef x, ux(sed)| 


(2.24) 


max = 
p ip 


where the expectation is taken over sg, k = 1,..., K. 
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The above problem is very difficult to solve in its current form as it consists of a 
ratio of two addictive cost functions. To tackle it, a new sequential decision-making 
problem is formed with the states and decisions defined same as above but the cost 
function at stage k, k = 1,..., K, which is more precisely considered as a reward 
function, defined as follows 


Gi (sp, Uk; A) = 8È (Sk, Uk) — ABE (Sk, UK) 


0, ifs, =T 
=} Fi lhe, Pi) — Arps, if sy AT and uy = p, (2.25) 
—AXTDPs, otherwise 


where à > 0 is a parameter which can be considered as the price per unit of energy 
consumption, and 


Fi(h, p, à) = OTB log, (1 + SNR«(A, p)/T) — AT (ap + pe) (2.26) 


For a given value of À, the objective of the new sequential decision-making prob- 
lem is to find a sequence of functions, ġ (à) = {m1 (s1; A),..., Ux (SK; A)}, Mapping 
each (sg; A) intoacontrolu, = lz (s,; A) to maximize the expected long-term reward. 
Mathematically, this can be expressed as 


K 
max Jyo) = Ey >) Gelse, Halse, A); of (2.27) 
k=1 


Equation (2.27) is parameterized by A. Clearly, for different values of à, we have 
different parametric formulations and thus different resulting optimal policies. Each 
of the parametric formulations in (2.27) can be considered as an energy-aware design 
of the sensing-access policies since the throughput can be treated as the monetary 
reward and both the sensing energy and the transmission energy can be treated as 
cost. The beauty of this is that unlike the original problem in (2.24), the parametric 
formulation in (2.27) has an additive and separable structure, which allows dynamic 
programming to be applied. 

By using backward induction, the optimal policy after observing channel k is idle, 
i.e., sk Æ (1, 0), can be found as 


wB iTo2 Pmax . ok 7 . a 
ides | [ its = ae if Fè (hp, A) > E {Jei (Sk41; )} ork = N 


C, otherwise 


(2.28) 


where F,°(h,4) = max F(h, u, à) represents the maximum immediate net 
UE| Pmin, Pmax 
reward associated with transmitting over channel k, pin is a predefined small positive 


power level and Pmax is the maximum transmit power allowed due to the hardware 
limitation or some other regulations. 
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The above result has the following interpretations: 


First, since F% (hg, à) is anon-increasing function in hg and E {Jk+1 (Sz+1; A)} isa 
constant value once it is computed, the condition Fë (hy, A) > E {Jk+1(Sk+1; A)} is 
equivalent to hy > hy where h k is the minimum of h; that satisfies the condition. 
This indicates that the optimal sensing policy which determines when to stop 
sensing has a threshold structure. The SU will transmit over an idle channel only 
when the channel condition is good enough. 

Second, the optimal access policy which specifies the optimal power allocation has 
a waterfilling structure with the water level determined by the price À for energy 
consumption and the perceived spectrum opportunity of the channel œx. It can 
be seen from the expression that the SU will transmit with a higher power when 
the price for energy consumption is lower and/or when the perceived spectrum 
opportunity is larger. 


In [16], it has been shown that the original problem in (2.24) and the parametric 
formulation are related in such a way that ng» = 4* if and only if Jy.(A*) = 0. This 
shows that the energy-aware sensing-access design that has zero expected long-term 
reward is the most energy-efficient sensing-access design. In addition, the maximum 
energy efficiency is equal to the price for the energy-aware design in this case. 
Furthermore, based on the monotonicity of the function Jy: (A), an iterative algorithm 
has been proposed to find the optimal 4*. 

Consider the following scenario for the sequential spectrum sensing with a band- 
width of B = 6 MHz, noise power spectrum density of No /2 = —204 dBW/Hz, noise 
figure of Ny = 10dB, noise power of o? = NBN f, distance between the SU-TX 
and the SU-RX of d = 200 m, carrier frequency of fe ı = 700 MHz, fek+1 — fek = 


2 
B for k = 1,..., K — 1, propagation loss of pp = (=) , link margin of ı = 


10dB, bit error rate of BE R = 1075, SNR gap to channel capacity of T ~ — BORER) A 
minimum transmit power of Pmin = 1 mW, maximum transmit power of Pmax = 
166.62 mW, circuit power of pe = 210mW, sensing power of p, = 110mW,, trans- 
mission or frame time of T = 100ms, PU idle probability of 6 = 0.8, SU channel 
distribution of h = {1, 2, 3, 4, 5} with probability of {0.64, 0.23, 0.09, 0.03, 0.01}, 
PU worst-case received SNR yg = —20 dB, target probability of detection of Pix = 
0.9, PAR of € = 6 dB, and drain efficiency of ¢ = 0.35. 

In Fig. 2.8, the achieved energy efficiency of the optimal sensing-access policies 
is compared with two suboptimal policies for K = 6 channels and the access time 
Tk = T. The first suboptimal scheme consists of a sensing policy that always trans- 
mits over the first available channel and an access policy based on adaptive power 
allocation. The second suboptimal scheme allows the exploration of diversity of mul- 
tiple available channels but always uses the maximum transmit power. It can be seen 
from the figure that the optimal scheme outperforms both suboptimal ones. 

In Fig. 2.9, the achieved energy-efficiency is plotted versus sensing time when 
the number of channels k varies. We can see that with more number of channels, 
the energy efficiency is improved and the optimal sensing time is reduced due to the 
increased channel diversity effect. 
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Fig. 2.8 Energy efficiency versus sensing time for K = 6 channels (constant transmission time) 
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35 


34 2 Opportunistic Spectrum Access 


2.4.2 Optimal Sensing Order 


The above formulation only considers the design of the sensing policy and the access 
policy in terms of power allocation strategy with a given sensing order. However, it 
can be modified to incorporate the design of the optimal sensing order. In this case, 
the SU will have to decide which channel to sense next if the current channel is given 
up for transmission. To do so, the state and decision have to be modified as follows. 


e State: Denote i, as the index of the channel sensed at stage k and (2, as the set of 
channels that has not been sensed at stage k. Then the joint variable (s;,, Q) can 
be taken as the state at stage k. Different from the formulation in Sect.2.4.1, one 
more decision has to be made before the first channel is sensed. To be consistent, 
the moment when such a decision is made is denoted as stage 0. At stage 0, we 
have (s;,, Qx) = (Ø, Qo) where Qo = {1,..., K} and Ø is a null index. 

e Decision: At stage k, in addition to determining the power allocation and the 
sensing policy, the SU has to determine the index of the channel to be sensed next 
if the current channel is given up. In this case, the decision is uz = j, j E€ Qk. 


The objective is to find a sequence of functions @ = {uo (Ø, Qo), M1 (Si, 21),..-, 
UK (Siz, Ø)}, with ug, k = 0, 1,..., K, mapping each state (s;,, Q4) into a control 
Uk = [Ux (Sip, Qg), to maximize the energy efficiency of the whole process. Mathe- 
matically, this can be expressed as 


r [EKo g (si Res relsi 20) f 


z pa BE (Sips Qk, HES, 2%))] 


(2.29) 


max 7 = 
rA 


Similar to the case when the sensing order is fixed, the above problem can be 
related to a parametric formulation parameterized by à. The optimal strategy for the 
parametric formulation can be found as follows 


Me (Si,, Qk; A) 
27 Prax , , , 
a ae if Fi hu A) = max Elis (Sj, % — j; A) 
argmax E{ Jk+1 (sj, Q — j; à)}, otherwise 


JERK 
(2.30) 


Compared to the result for the case of given sensing order, the following conclusions 
can be drawn. First, the optimal power allocation has the same structure as (2.28). Sec- 
ond, the optimal sensing strategy also has a threshold structure due to the monotonic- 


ity of Fi (hi,, 4). The condition Fi. (hi A) = max S{Jk+1 (Sj, Qg — j; A)} indicates 
JEStk 


that sensing is stopped when the immediate net reward is greater than the expected 
future net reward of continuing sensing any of the remaining channels. Lastly, if 
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Fig. 2.10 Energy efficiency versus sensing time with {0),..., 6x} = {0.2, 0.4, 0.6, 0.7, 0.8} 
(constant transmission time) 


the current channel is given up, the best channel to sense next is the one with the 
maximum expected future net reward. 

Consider that there are K = 5 channels with the corresponding PU idle probability 
set as {01,..., 9x} = {0.2, 0.4, 0.6, 0.7, 0.8} while other settings remain the same 
as above. Figure 2.10 compares the energy efficiency achieved by using the optimal 
sensing order at different values of sensing time with that achieved with two given 
sensing orders. It can be seen that the optimization of sensing order is important to 
improve the energy efficiency of the sequential spectrum sensing process. 


2.5 Applications: LTE-U 


An important application of OSA is the long-term evolution in unlicensed band (LTE- 
U), which is also known as licensed-assisted access (LAA) [17, 18]. The motivation 
of introducing LTE service in unlicensed band comes from the crisis of licensed 
spectrum exhausting of LTE service and the under-utilization of unlicensed bands, 
such as 5 GHz band which contains 500 MHz radio resource and is mainly used by 
WiFi service. These bands can be excellent complementary spectrum for enhancing 
the LTE performance. Through carrier aggregation, the data information can be 
conveyed via licensed and unlicensed spectrum simultaneously, while the control 
signal can be still transmitted via licensed spectrum for QoS guarantee. Introducing 
LTE in unlicensed bands requires the LTE to be a fair and friendly neighbor of 
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the incumbent WiFi in unlicensed bands. To achieve this goal, critical problems, 
including the protection to WiFi system, efficient coexistence between LTE and 
WiFi system, and efficient user association need to be addressed. 


2.5.1 LBT-Based Medium Access Control Protocol Design 


Since WiFi adopts contention-based media access, the access of LTE will introduce 
collision to the WiFi transmission. To mitigate this collision, listen-before-talk (LBT) 
scheme, which enables the LTE to monitor the channel status, can be adopted by 
LTE, which has been shown to be able to maintain the most advantages of LTE when 
coexisting with WiFi system [19]. Moreover, when LTE transmits on the channel, 
the WiFi users will keep silent and wait for the channel becomes idle. To guarantee 
the normal service of WiFi, the LTE should vacate from the channel after a period 
of data transmission and leave the channel to WiFi operation. Thus, we can see that 
the LBT-based MAC protocol of LTE-U should contain the periodic channel sensing 
phase which is followed by data transmission phase and channel vacating phase. 
In the channel sensing phase, the LTE monitors the channel idle/busy status. If the 
channel is sensed idle, the LTE transmits data for a period of time. After that, the 
LTE system vacates from the channel for WiFi transmission. 

It can be seen that the LBT-based MAC protocol is similar to the sensing- 
transmission protocol of the typical OSA system, except that the channel vacating 
phase is absent in the latter one. This is because that in the typical OSA system, 
the primary system has higher priority to the secondary system, and thus the sec- 
ondary system can only passively adapt than the transmission of primary system. 
In the LTE-U system, however, although the legacy WiFi system is protected, the 
secondary LTE system can actively control the transmission of WiFi by carefully 
designing the sensing period and the transmission time. 

To protect WiFi services, the performance of the multiple WiFi users should be 
quantified with the coexistence of LTE. There are works on evaluating the perfor- 
mance of LTE-U via simulation [20-22]. To facilitate the theoretical analysis of LTE- 
U system, an LBT-based LTE-U MAC protocol is designed as shown in Fig. 2.11 [23]. 
In this protocol, Ts, T; and T, denote the spectrum sensing time, the LTE transmission 
time, and the LTE vacating time (WiFi transmission time), respectively. Moreover, 
the vacating time t, contains y (y € Z*) transmission periods (TPs), each of which 
contains the WiFi packet transmission time and its propagation delay. Assuming that 
the spectrum sensing result is perfect, the LBT-based MAC protocol can be specified 
as follows. 


e Instead of sensing spectrum at the beginning of each frame, the LTE starts and 
keeps sensing from the beginning of the yth TP in a frame. Once the channel is 
sensed to be idle and the TP is not completed, the LTE will send a dummy packet 
until the TP ends. By doing so, the WiFi packet arrived during the yth TP will be 
deferred and the channel can be held by the LTE for the next frame. 
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Fig. 2.11 An LBT-based MAC protocol design for LTE-U 


Though the spectrum sensing of LTE for the ith frame may happen within the final 
TP of the (i — 1)th frame, the length of LTE frame can be consistently quantified 
as T = 1, + 1,. Thus, given T, we can trade off the LTE transmission time and 
vacating time to optimize the system performance. 

There is an essential difference between the proposed MAC protocol and the 
sensing-transmission protocol of the traditional OSA system, although they are 
both frame-based. In the traditional OSA system, SU can transmit only when the 
channel is sensed to be idle. In the proposed MAC protocol, however, the LTE 
not only senses the channel, but also grabs the channel for data transmission in 
the next frame. Therefore, there is always transmission opportunity for the LTE in 
each frame. 


Based on this protocol design, the performance of the LTE and the WiFi system can 
be theoretically quantified by mapping the protocol parameters to that in [24]. With 
the closed-form throughput and delay performance of WiFi, the protocol parameters, 
including the LTE transmission time and the frame length can be optimized in terms 
of maximizing the LTE throughput or the overall channel utilization. 


2.5.2 User Association: To be WiFi or LTE-U User? 


One important observation obtained in the performance analysis of the LBT-based 
LTE-U MAC protocol design is that when a batch of new users join in the networks, 
it is not always advantageous to be LTE-U users in terms of individual throughput of 
the new users or the overall channel utilization. The simulation results in [23] have 
shown that whether the new users should join in the LTE-U system or the legacy 
WiFi system to get a better performance is highly determined by the traffic load of 
the existing WiFi system, including the packet arrival rate and the number of WiFi 
users. Therefore, the user association, which determines the provider of the service 
for the new users, should be optimized. 

In order to maximize the normalized throughput of the unlicensed band with guar- 
anteeing the QoS of WiFi service, a joint resource allocation and user association 
problem is proposed for a heterogeneous network, where the LTE small cells oppor- 
tunistically access the spectrum of WiFi system [25]. For solving the problem, a 
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two-level learning-based framework is proposed with which the original problem is 
decomposed into two subproblems. The master level problem, which aims to opti- 
mize the transmission time of LTE, has been solved by a Q-learning based method; 
while the slave one, which aims to optimize the user association, has been solved by 
a game-theory based learning method. With the proposed scheme, each of the newly 
enrolled users can choose the optimal resource allocation strategy and the service 
provider autonomously. 

Considering that the QoS of the LTE-U users is not guaranteed in the existing 
literatures, the authors in [26] study the provision of QoS guarantee for the LTE-U 
by jointly optimizing the resource allocation and the user association strategy. To 
address the QoS provision problem, the users in the LTE-U system are classified into 
best-effort users and QoS-preferred users, while the WiFi users are all treated as the 
best-effort users. When the QoS requirement of an LTE-U user can be satisfied, the 
user becomes the QoS-preferred user; otherwise, it will join in the WiFi system as a 
normal WiFi user to receive the best-effort service. By quantifying the performance 
matrices, including the throughput and delay of the WiFi user and the LTE-U user, 
the optimization problem is formulated with the objective of maximizing the number 
of QoS-preferred users, with guaranteeing the fair coexistence of WiFi and LTE-U 
users. To solve this problem, the original problem is equivalently decomposed into 
two subproblems, i.e., the sum-power minimization problem and the user association 
problem. For the former problem, the deep-cut ellipsoid method is used to optimize 
the LTE transmission time, subcarrier assignment, and power allocation. For the latter 
one, a successive user removal algorithm is proposed. This scheme can realize that 
all the LTE-U users are QoS guaranteed and the number of such users is maximized. 


2.6 Summary 


In this chapter, we have discussed in detail about the OSA technique from the basic 
OSA model based on which the sensing-access protocol is designed. The sensing- 
throughput tradeoff has been presented, with which the cooperative spectrum sensing, 
sensing scheduling and sequential spectrum sensing are introduced. As a recent 
application of OSA in practical networks, the LTE-U has been presented, in which 
several critical problems, including the MAC protocol design and optimization, the 
resource allocation, and the user association, have been addressed. 
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Chapter 3 A) 
Spectrum Sensing Theories and Methods sv 


Abstract Spectrum sensing is a critical step in cognitive radio based DSM to learn 
the radio environment. Despite its long history, in the past decade, the study on spec- 
trum sensing has attracted substantial interests from the wireless communications 
community. In this chapter, we first provide the fundamental theories on spectrum 
sensing from the optimal likelihood ratio test perspective, then we review the clas- 
sical methods including Bayesian method, robust hypothesis test, energy detection, 
matched filtering detection, and cyclostationary detection. After that, we discuss the 
robustness of the classical methods and review techniques that can enhance the sens- 
ing reliability under hostile environment. These methods include eigenvalue based 
sensing method, covariance based detection method. Finally, we discuss the cooper- 
ative sensing that uses data fusion or decision fusion from multiple senors to enhance 
the sensing performance. 


3.1 Introduction 


As mentioned in Chap. 1, the basic idea of a cognitive radio is to support spectrum 
reuse or spectrum sharing, which allows the secondary networks/users to communi- 
cate over the spectrum allocated/licensed to the primary users (PUs) when they are 
not fully utilizing it. To do so, the secondary users (SUs) are required to frequently 
perform spectrum sensing, i.e., detecting the presence of the PUs. Whenever the PUs 
become active, the SUs have to detect the presence of them with a high probability, 
and vacate the channel or reduce transmit power within certain amount of time. For 
example, in the IEEE 802.22 standard [1-3], it is required for the SUs to detect the 
TV and wireless microphone signals and vacate the channel within two seconds once 
they become active. Furthermore, for TV signal detection, it is required to achieve 
90% probability of detection and 10% probability of false alarm at signal-to-noise 
ratio (SNR) level as low as —20dB [1]. 

Spectrum sensing has reborn as a very active research topic in the past decade 
despite its long history in signal detection field. Quite a few new sensing methods 
have been proposed which take into consideration practical requirements and con- 
straints. In this chapter, we first provide the fundamental spectrum sensing theories 
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from the optimal likelihood ratio test perspective, then review the classical methods 
including Bayesian method, robust hypothesis test, energy detection, matched filter- 
ing detection, and cyclostationary detection. After that, we discuss the robustness 
of the classical methods and review techniques that can enhance the sensing relia- 
bility under hostile environment, including eigenvalue based sensing method, and 
covariance based detection. Finally, we discuss the cooperative spectrum sensing 
techniques that uses data fusion or decision fusion to combine the sensing data from 
multiple senors. 


3.1.1 System Model for Spectrum Sensing 


We consider an SU spectrum sensor with M > 1 antennas. A similar scenario is 
the multi-node cooperative sensing, if all M distributed nodes are able to send their 
observed signals to a central node. There are two hypotheses: Ho, the PU is inactive; 


and H,, the PU is active. The received signal at antenna/node i, i = 1,..., M, is 
given by 
Ho: xi(n) = ni(n) (3.1) 
Hy: x(n) = s;(n) + ni(n) (3.2) 


where n; (n) is the received noise plus possible interference. At hypothesis H4, s; (n) 
is the received primary signal at antenna/node i, which is the transmitted primary 
signal passing through the wireless channel to the sensing antenna/node. That is, 
5;(n) can be written as 


qi 
si(n) = $ hi DSa- (3.3) 
1=0 


where s(n) stands for the transmitted primary signal, h; (1) and q; denote the propa- 
gation channel coefficient and channel order from the PU to the ith antenna/node. For 
simplicity, it is assumed that the signal, noise, interference, and channel coefficients 
are all real numbers, though the theory and derivation can be directly extended to 
complex signals in most of the cases. 

The objective of spectrum sensing is to choose one of the two hypotheses, Ho 
or H1, based on the received signal samples at the SU sensor. The probability of 
detection, P4, and probability of false alarm, Pfa, are defined as follows: 


Pa = P (HH) (3.4) 
Pfa = P (Hi (Ho) (3.5) 


where P(-|-) defines the conditional probability. There are interesting physical mean- 
ings for the above two probabilities: Pz defines how well the PU is protected when 
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it is using the spectrum, while Pr, determines the opportunity the SU misses out 
when the PU is not using the spectrum. In general, a sensing algorithm is said to be 
“optimal” if it achieves the lowest Py, for a given Py with a fixed number of sam- 
ples, though there could be other criteria to evaluate the performance of a sensing 
algorithm. 

In order to apply both space and time processing, we stack the signals from the 
M antennas/nodes and L time samples to yield the following ML x | vectors: 


x(n) = [xı (n)...xy(n) xı(n —1)...xy(n — 1) 


...xı(n— L+ 1)...xy(n — oe om (3.6) 
s(n) = [sı(n)...sm (n) sy(n—1)...sy(n — 1) 

(Nn -L+1)...sy¥n—-L+)]/° (3.7) 
n(n) =[m(n)...nu(n) m(n—1)...nu(a— 1) 

mn- L+1)...nu(n— L +1)" (3.8) 


Based on the above vector forms, the hypothesis testing problem can be reformu- 
lated as 


Ho: x(n) = n(n), n=0,...,N—1. (3.9) 
H, :x(n)=s(n)+ y(n), n=0,...,N—-1. (3.10) 


Accurate knowledge on the noise power a is the key for many detection methods. 
Unfortunately, in practice, the noise uncertainty always presents. Due to the noise 
uncertainty [4—6], the estimated (or assumed) noise power may be different from 
the real noise power. Let the estimated noise power be a = ee It is assumed 
that «œ (in dB) is uniformly distributed in an interval [—B, B], where B is called the 
noise uncertainty factor [5]. In practice, the noise uncertainty factor of a receiving 
device is typically in the range from | to 2 dB, but the environment/interference noise 
uncertainty can be much higher [5]. 


3.1.2 Design Challenges for Spectrum Sensing 


The design of spectrum sensing methods in CR faces a few specific challenges 
including, among others, the following. 


1. Low sensing SNR: A cognitive radio may need to sense the primary signal at 
very low SNR condition. This is to overcome the hidden node problem, i.e., a 
SU sensor hears very weak signal from the primary transmitter but can strongly 
interfere the primary receiver if it transmits (here the primary receiver looks like a 
hidden node). To avoid such interference, one solution is to require the SU sensor 
to have the capability to sense the presence of the primary signal at very low SNR. 
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For example, in the 802.22 standard, the sensing sensitivity requirement is as low 
as —20 dB. 

2. Channel uncertainty: In wireless communications, the propagation channel is usu- 
ally unknown and time variant. Such unknown channel makes coherent detection 
methods unreliable in practice. 

3. Non-synchronization: It is hard to synchronize the received signal with the pri- 
mary signal in time and frequency domains. This will cause traditional methods 
like preamble/pilot based detections less effective. 

4. Noise uncertainty: The noise level may vary with time and location, which yields 
the noise power uncertainty issue for detection [4-7]. This makes methods relying 
on accurate noise power unreliable. Furthermore, the noise may not be white, 
which will further affect the effectiveness of many methods with white noise 
assumption. 

5. Interference: There could be interferences from intentional or unintentional trans- 
mitters. Thus, the detector needs to have the capability to suppress the interference 
while identifying the primary signals. 


While there have been a lot of spectrum sensing methods in the literature [8—15], 
many of them are based on ideal assumptions, and cannot work well in a hostile radio 
environment. We need the spectrum sensing to be robust to the unknown and maybe 
time-varying channel, noise and interference. 


3.2 Classical Detection Theories and Methods 


In this section, we first provide the fundamental theories on spectrum sensing from 
the optimal likelihood ratio test perspective, then we review the classical methods 
including Bayesian method, robust hypothesis test, energy detection, matched filter- 
ing detection, and cyclostationary detection. 


3.2.1 Neyman—Pearson Theorem 


The Neyman—Pearson (NP) theorem [16-18] states that, for a given probability of 
false alarm, the test statistic that maximizes the probability of detection is the likeli- 
hood ratio test (LRT) defined as 


pM) 


3.11 
p(x|Ho) en 


Ther (x) = 


where p(-) denotes the probability density function (PDF), and x denotes the received 
signal vector that is the aggregation of x(n), n = 0, 1,..., N — 1. Such a likelihood 
ratio test decides Hı when Tz x7 (x) exceeds a threshold y, and Ho otherwise. 
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The major difficulty in using the LRT is its requirement on the exact distributions 
given in (3.11). Obviously, the distribution of random vector x under H; is related 
to the source signal distribution, the wireless channels, and the noise distribution, 
while the distribution of x under Ho is related to the noise distribution. In order to 
use the LRT, we need to obtain the knowledge of the channels as well as the signal 
and noise distributions, which is practically difficult to realize. 

If we assume that the channels are flat-fading, and the received source signal 
sample s;(”)’s are independent over n, the PDFs in LRT are decoupled as 


N-1 

POIH) = | [ pam) (3.12) 
n=0 
N-1 

PRIH) = | | pm Ao) (3.13) 


n=0 


If we further assume that noise and signal samples are both Gaussian distributed, i.e., 
n(n) ~ NO, oiT) and s(n) ~ N (0, R,;), the LRT becomes the estimator-correlator 
(EC) [16] detector for which the test statistic is given by 


N-1 


Trc(x) = $ x" R, (R, + 0,1) 'x(n) (3.14) 
n=0 


From (3.10), we see that R,(R; + 20,1) 'x(n) is actually the minimum-mean- 
squared-error (MMSE) estimation of the source signal s(n). Thus, Tgc (x) in (3.14) 
can be seen as the correlation of the observed signal x(n) with the MMSE estimation 
of s(n). 

The EC detector needs to know the source signal covariance matrix R, and noise 
power ae. When the signal presence is unknown yet, it is unrealistic to have the 
knowledge on the source signal covariance matrix which is related to unknown 
channels. 


3.2.2 Bayesian Method and the Generalized Likelihood Ratio 
Test 


In practical scenarios, it is difficult to know the likelihood functions exactly. For 
instance, we may not know the noise power o and/or source signal covariance Ry. 
Hypothesis testing in the presence of uncertain parameters is known as “composite” 
hypothesis testing. In classic detection theory, there are two main approaches to 
tackle this problem: the Bayesian method and the generalized likelihood ratio test 
(GLRT). 
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In the Bayesian method [16], the objective is to evaluate the likelihood functions 
needed in the LRT through marginalization, i.e., 


P(%|Ho) = | vamo, Oo) P(©o|Ho)d@o (3.15) 


where ©p represents all the unknowns when Ho is true. Note that the integration 
operation in (3.15) should be replaced with a summation if the elements in @o are 
drawn from a discrete sample space. Critically, we have to assign a prior distribu- 
tion p(@o|Ho) to the unknown parameters. In other words, we need to treat these 
unknowns as random variables, and use their known distributions to express our 
belief in their values. Similarly, p(x|H1) can be defined. The main drawbacks of the 
Bayesian approach are listed as follows: 


1. The marginalization operation in (3.15) is often not tractable except for very 
simple cases; 

2. The choice of prior distributions affects the detection performance dramatically 
and thus it is not a trivial task to choose them. 


To make the LRT applicable, we may estimate the unknown parameters first 
and then use the estimated parameters in the LRT. Known estimation techniques 
could be used for this purpose. However, there is one major difference from the 
conventional estimation problem where we know that signal is present, while in the 
case of spectrum sensing we are not sure whether there is source signal or not (the 
first priority here is the detection of signal presence). At different hypothesis, Ho or 
Hı, the unknown parameters are also different. 

The GLRT is one efficient method [16, 18] to resolve the above problem, which 
has been used in many applications, e.g., radar and sonar signal processing. For this 
method, the maximum likelihood estimation of the unknown parameters under Ho 
and H; are first obtained as 


Oo = arg max p(x|Ho, Oo) 
IO 


= 


| = argmax P(xlF, 01) 
21 


where ©ọ and ©, are the set of unknown parameters under Ho and 7, respectively. 
Then, the GLRT statistic is formed as 


p(x|O1, Hi) 


x (3.16) 
P(&|@o0, Ho) 


TGLRT = 


Finally, the GLRT decides Hı if Tg_rr(x) > y, where y is a threshold, and Ho 
otherwise. 

It is not guaranteed that the GLRT is optimal or closes to the optimum when the 
sample size goes to infinity. Since the unknown parameters in © and ©, are highly 
dependent on the noise and signal statistical models, the estimations of them could 
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be vulnerable to the modeling errors. Under the assumption of Gaussian distributed 
source signals and noises, and flat-fading channels, some efficient spectrum sensing 
methods based on the GLRT can be found in [19-21]. 


3.2.3 Robust Hypothesis Testing 


The searching for robust detection methods has been of great interest in the field of 
signal processing and many others. In this section, we start from a general paradigm 
that is called robust hypothesis testing, then we review a few methods that are robust to 
certain impairments. In Sects. 3.3-3.5, we will discuss a few new methods, including 
eigenvalue based detections, covariance based detections, and cooperative sensing. 

A useful paradigm to design robust detectors is the maxmin approach, which 
maximizes the worst case detection performance. Among others, two techniques are 
very useful for robust spectrum sensing: the robust hypothesis testing [22, 23] and 
the robust matched filtering [24, 25]. In the following, we will give a brief overview 
on them. 

Let the PDF of a received signal sample be fı at hypothesis H; and fo at hypothesis 
Ho. If we know these two functions, the LRT-based detection described in Sect. 3.2.2 
is optimal. However, in practice, due to the channel impairment, noise uncertainty, 
and interference, it is very hard to obtain these two functions exactly. One possible 
situation is when we only know that fı and fo belong to certain classes. One such 
class is called the €-contamination class given by 


Ho : fo € Fo, Fo = {(1 — €o) fÈ + cogo} (3.17) 
WM: fie Rh, Fh ={0— e) f? + egi} f 
where F? (j = 0, 1) is the nominal PDF under hypothesis H}, €; in [1, 0] is the 
maximum degree of contamination, and g; is an arbitrary density function. Assume 
that we only know f z and €; (an upper bound for contamination), j = 1,2. The 
problem is then to design a detection scheme to minimize the worst-case probability 
of error (e.g., probability of false alarm plus probability of mis-detection), i.e., finding 
a detector W such that 


A 


W=argmin max Pra(fo, fi: VW) +1— Pilo, fi, Y 3.18 
2 y ee falfo, fi, Y) alfo, fi, Y)) ( ) 


Hubber [22] proved that the optimal test statistic is a “censored” version of the LRT 
given by 
N-1 
Ô = Terer(x) = | [ re) (3.19) 
n=0 
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where 
PO 
PO 
a NG ot) 
"O= | shen © < o <a ma 
LO 
Co FO) SO 


ci, Crs 


and co, cı are nonnegative numbers related to €o, €1, R , and fe [22, 26]. Note that 
if choosing co = 0 and c; = +09, the test is the conventional LRT with respect to 
nominal PDFs, f? and f?. 

One special case is the robust matched filtering. We turn the model (3.10) into a 
vector form as 


Ho: x=y (3.21) 
Hi :x=st+y (3.22) 


where s is the signal vector and ņ is the noise vector. Suppose that s is known. In 
general, a matched-filtering detection is Tyr = g’x. Let the covariance matrix of 
the noise be R, = E(qn’ ). If R, = ofl, it is known that choosing g = s is optimal. 
In general, it is easy to verify that the optimal g to maximize the SNR is 


_ p-l 
g =R; s- (3.23) 


In practice, the signal vector s may not be known exactly. For example, s may be 
only known to be around sọ with some errors modeled by 


\|s—So|| < A (3.24) 


where A is an upper bound on the Euclidean-norm of the error. In this case, we are 
interested in finding a proper value for g such that the worst-case SNR is maximized, 
i.e., 

= argmax min SNR(s,g) (3.25) 


g  s:||s—so|| <A 
It was proved in [24, 25] that the optimal solution for the above maxmin problem is 
& = (R, + ôD 'so (3.26) 


where ô is a nonnegative number such that 8?||ĝ||? = A. 

It is noted that there are also researches on the robust matched filtering detec- 
tion when the signal has other types of uncertainty [26]. Moreover, if the noise has 
uncertainties, i.e., R, is not known exactly, or both noise and signal have uncertain- 
ties, the optimal robust matched-filtering detector was also found for some specific 
uncertainty models in [26]. 
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3.2.4 Energy Detection 


If we further assume that R, = ofl, the EC detection in (3.14) reduces to the well- 
known energy detector (ED) [4, 27, 28] for which the test statistic is given as follows 
(by discarding irrelevant constant terms). 


N-1 
Trp = > 2 x! (n)x(n) (3.27) 


Note that for the multi-antenna/node case, Tgp is actually the summation of energies 
from all antennas/nodes, which is a straightforward cooperative sensing scheme [29— 
31]. 

The test statistic is compared with a threshold to make to decision. Obviously the 
threshold should be related to the noise power. Hence energy detection needs a priori 
information of the noise variance (power). It has been shown that energy detection is 
very sensitive to the inaccurate estimation of the noise power. We will give detailed 
discussion on this later. 

From the derivation above, we know that energy detection is the optimal detection 
if there is only one antenna, the signal and noise samples are independent and iden- 
tically distributed (iid) Gaussian random variables, and the noise variance (power) 
is known. Even if the signal and noise do not have Gaussian distribution, in most 
cases, energy detection is still approximately optimal for uncorrelated signal and 
noise at low SNR [32]. In general, the ED is not optimal if signals or noise samples 
are correlated. 

The energy detection can be used in different ways and sometimes combined with 
other techniques. 

(1) We can filter the signal before the energy detection is implemented. Let f (/) 
(l= 0,1,..., L) bea filter or the combining of a bank of filters. The received signal 
after filtering is 


L 
yin) =) fxn- (3.28) 


1=0 


The energy detection after the filtering is therefore 


N-1 
1 
Trp, Fitter = YS yw? (3.29) 
n=0 


For practical applications, we can choose a narrowband filter or a bank of narrowband 
filters if we want to detect the signals in specific frequency bands. 

(2) Energy detection can also be done in frequency domain. Let S; (k) be the power 
spectrum density (PSD) of the received signal x;(n). There are different methods to 
estimate the PSD including periodogram, multitaper method (MTM) [33, 34] and oth- 
ers. For the periodogram method, the received signal is divided into P non-overlapped 
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blocks: x; p(n) with length Np. Let X; p(k) be the discrete Fourier transform (DFT) 
of x; p(n). Note that DFT can be computed by the fast Fourier transform (FFT). The 
PSD is estimated as 


1 P 
S6 = 5 D Xi (3.30) 


p=1 


The test statistic of the frequency domain energy detection is: 


ee 


1 
TED,F = WM 


Nj- 
S S; (k) (3.31) 
k=0 


i 


Again the test statistic is compared with a threshold to make a decision and the 
threshold should be related to the noise power. 

Among all the spectral estimation methods, the MTM is proved to achieve the 
performance close to the maximum likelihood PSD estimator [33, 34]. Thus it can 
be used to make a more accurate estimation of the PSD for spectrum sensing [35]. 
However, the computational complexity is also increased. 

(3) The frequency domain energy detection can also be done in a more flexible way. 
Let w be a subset of set {0, 1,..., Ny — 1}. We can select the signal frequency within 
the bin y for detection and may also give different weights to different antennas and 
frequencies [36]. The test statistic is therefore 


T, iksi (k 3.32 
EDF = TELs (k) (3.32) 


i=l key 


where g; x is the weight for antenna i and frequency index k. This can have a better 
performance if we know that the interested signal power has peaks or is concentrated 
in the frequency bin y. For example, for ATSC signal detection, we know that the 
signal has a strong peak at the pilot. So we can choose the set y to be the frequency 
index around the pilot location. A special case is to choose just one frequency index 
nearest to the pilot location. In some OFDM based standards, the pilot subcarriers 
have higher power than other subcarriers. We can put more weights to the pilot 
subcarriers. 

Another variation of the method is to change the averaging of the signal PSD to 
maximizing [37]. The test statistic becomes 


M 
1 
TED, Max = Max -7 2 S; (k) (3.33) 


The energy detection can also be done in other transform domains other than 
the Fourier transform domain. In general, let X; r (k) (k = 0, 1,..., K — 1) be the 
transformed signal of the original received signal x; (n). The transform domain energy 
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detection is 


1 M K 
Tepr = — } } Xiro? (3.34) 


For example, the wavelet can be chosen as the transform, which turns to the wavelet 
multi-resolution detection [38]. In general, the transform should be chosen based on 
the signal and noise property or/and purpose of detection. 


3.2.5 Sequential Energy Detection 


In the discussions above, we assume that the sensing time (number of signal samples 
N) is a predefined fixed number. The detector is designed to have the optimal per- 
formance with the given sample size. In some applications, the sensing time may not 
be predefined. Our purpose is to design a detector that has the least average sensing 
time. A popular approach for this is the sequential detection [39-41]. 

In general, a sequential detector makes a decision whenever a new signal sam- 
ple is available. For simplicity, here we consider single detector case. Let x, = 
(x(0), x(1),...,x(k — 1))’ be signal samples currently available at time k. The 
sequential detector calculates a test statistic T(x;). It then makes a decision using 
two thresholds: 


T(x) > yı, Hı (3.35) 
T (xx) < yo, Ho (3.36) 


where yı > yo are some predefined thresholds. If the test statistic is between yı and 
yo, that is, yo < T (x4) < yı, the detector does not make a decision on H, or Ho yet: 
more samples are required. The detector will continue this process when new signal 
samples are available till a decision on Hı or Ho is reached. 

Thus we do not know when the detection will finished to achieve the target sensing 
performance. The sensing time is a random number. It is proved that the average 
sensing time is shorter than the conventional methods (the Wald—Wolfowitz theorem 
[40]). However, the worst case sensing time could be much longer. 

Using the energy detection for sequential detection is discussed in [40]. Some 
extensions and refinements can be found in [40]. 


3.2.6 Matched Filtering 


If we assume that noise is Gaussian distributed and source signal s(n) is deterministic 
and known to the receiver, it is easy to show that the LRT in this case becomes the 
matched filtering based detector [16—18], for which the test statistic is 
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Tur = R (7 = Hone) (3.37) 


n=0 


The test statistic is compared with a threshold to make a decision. Obviously the 
threshold should be related to the noise power. Unlike energy detection, matched 
filtering (MF) is more robust to the inaccurate noise power estimation [6, 7]. MF is 
also widely used in other fields like radar signal processing. 

Hence, theoretically matched filtering is optimal if the signal is deterministic and 
known at the receiver. The major difficulties in MF are the time delay, frequency 
offset and time dispersive channel. 

For simplicity, we consider single antenna case here. In general, for a deterministic 
transmitted signal s(n), the received signal x(n) can be written as 


j2men 


JF 


x(n) = > hose —1—1)+7(n) (3.38) 


where t is the timing error, € is the normalized frequency offset and h(l) is the 
channel. 
At ideal case of € = 0, t = 0, L = 0 and h(O) > 0, 


Tur = WS Is(n)|? + R a it (n)n(n) (3.39) 
MF JN e . 


n=0 n=0 


In this case, MF is optimal. 

In practical wireless communication applications, the CFO e and timing error 
may not be zero, also the channel is most likely frequency selective: L > 0. So in 
general, the test statistic of MF should be expressed as 


N-1 L , Xo! 
Tur = eT" s*(n)s(n —1 — ») + Re (> samo) 
aes n=0 2 VN 2, 
(3.40) 
The CFO e, timing error and frequency selective are three major obstacles for the 
MF. Anyone of them could reduce the performance of MF dramatically. 
To deal with the timing error, a commonly used solution is to averaging or taking 
the maximum of the test statistic at different time delays of the received signal. Let 


N-1 
Tur (v) = (Fy So si (nxn + ») (3.41) 


n=0 


be the test statistic of the signal with time delay —v. Obviously the best value is 
v = tT. If we do not know the value of t, we can average on different v or take the 
maximum, that is, 
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A 


A 1 
Tura = za > Tur (v) (3.42) 
or A 
Tur = max Tur(v) (3.43) 


To tack the problem of CFO, we can modify the test of MF using the absolute 


value 
N-1 


Tur = a Yo toxa) (3.44) 


n=0 


This test is not affected by the carrier frequency offset. 

Similarly we can also average or take the maximum of the absolute value test 
statistics to deal with the timing error problem. 

Like the energy detection, the MF can also be implemented in frequency domain 
or transformed domain. Using the MF for ATSC signal detection is discussed in [42]. 


3.2.7 Cyclostationary Detection 


Practical communication signals may have special statistical features. For example, 
digitally modulated signals have non-random components such as double sideness 
due to sine wave carrier and keying rate due to symbol period. Such signals have 
a special statistical feature called cyclostationarity, i.e., their statistical parameters 
vary periodically in time. This cyclostationarity can be extracted by the cyclic auto- 
correlation (CAC) or the spectral-correlation density (SCD) [43-45]. 

For simplicity, in this section we consider single antenna case, that is, M = 1. For 
notation simplicity, we omit the subscript for antenna. For a given a and time lag T, 
the CAC of a signal x(t) is defined as 


iri 
R*(t) = lim if 
—> o0 m 


where œ is called a cyclic frequency. If there exists at least one non-zero œ such 
that max, |R% (t)| > 0, we say that x (t) exhibits cyclostationarity. The value of such 
a depends on the type of modulation, symbol duration, etc. For example, for a 
digitally modulated signal wah symbol duration T,, cyclostationary features exist at 
a= x anda = +2 fe + T where fe is the carrier frequency, and k is an integer. 


Equiv: tently, we can define the SCD, the Fourier transform of the CAC, as follows: 


(« + =) x* (: = =) eira gy (3.45) 


si> 


S(f)= f i Riga de (3.46) 


[0,9] 
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In binary spectrum sensing or signal detection, there are two hypotheses: Ho, 
signal absent; and #1), signal present. The received signal can be written as 


Ho : y(t) = nt) (3.47) 
Hi : y(t) = hit) B x(t) + nA) (3.48) 


where x(t) denotes the transmitted signal from the primary user, A(t) is the channel 
response, and n (t) is the additive noise. 

When source signal x(t) passes through a wireless channel A(t), the received 
signal is impaired by the unknown propagation channel. It can be shown that the 
SCD function of y(t) is 


Sy (f) = H(f +0/2)H*(f — a/2)Sx(f) (3.49) 


where « denotes the conjugate, œ denotes the cyclic frequency for x(t), H(f) is the 
Fourier transform of the channel h(t), and S,(f) is the SCD function of x(t). Thus, 
the unknown channel could have major impacts on the strength of SCD at certain 
cyclic frequencies. 

Cyclostationary detection (CSD) is well studied when Nyquist rate signal samples 
are available. The rationale behind the CSD is that the signal x (t) has cyclostationar- 
ity, that is, there exists at least one non-zero cyclic frequency œ such that R(t) A 0 
for some t, while the noise 7(t) is a pure stationary process, that is, for any non-zero 
a Ri (t) = 0 for all t’s, or equivalently $} (f) = 0 for all f’s. In the following, 
we list the cyclic frequencies for some signals with cyclostationarity in practical 
applications [44, 45]. 


1. Analog TV signal: It has cyclic frequencies at multiples of the TV-signal hori- 
zontal line-scan rate (15.75 KHz in USA, 15.625 KHz in Europe). 

2. AM signal: x(t) = a(t) cos(27 fet + oo). It has cyclic frequencies at +2 fọ. 

3. PM and FM signal: x(t) = cos(27 fet + @(t)). It usually has cyclic frequencies at 

+2 fe. The characteristics of the SCD function at cyclic frequency +2 fe depend 
on ġ(t). 

4. Digital modulated signals: 


a. Amplitude-Shift Keying: x(t) = és a, p(t —nAs — to)] cos(27x fet + 
oo). It has cyclic frequencies at k/A,;, k AO and +2f.+k/A,,k =0, 

SEWED, eu 

b. Phase-Shift Keying: x(t) = cos[27 fet + pa ay, p(t —nAs — to)]. For 
BPSK, it has cyclic frequencies at k/A;,k #0, and +2 fe +k/As,k = 
0, +1, +2, .. .. For QPSK, it has cycle frequencies atk/A;,k #0. 


5. OFDM modulated signal: It has cyclic features at cyclic frequency k/(N;T;), 
where k is an integer number, N, is the length of an OFDM block (FFT size plus 
CP size), and T, is the symbol duration. 
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Let œo be a non-zero cyclic frequency such that R%¥ (t) Æ 0 for some t. Assume 
that the signal and noise are mutually independent. Then we have 


Ho : RẸ (T) = 0 (3.50) 
Hı: RY (T) = R% (t) Æ 0, for some Tt (3.51) 


In the frequency domain, this turns to 


Ho: SPS) = 0 (3.52) 
Hi : SP) = S2 (S) # 0, for some f (3.53) 


Therefore, Ho and H; can be distinguished by generating a test statistic from the 
CAC/SCD of the received signal at cyclic frequency a and comparing the test 
statistic with a threshold. A typical test statistic isC; = f |R® (t) |?dr or equivalently 
Ci = f ISAP. 

In practice, the received signal is sampled and only limited number of samples 
are available. Let T, be the sampling period and N be the number of samples. The 
discrete version of the CAC is 


N-1 


1 , 
RIET) = — DO y(n + NT, )y* aT erT (3.54) 
n=0 


where the lag k = 0, 1,..., M — 1 with M << N. Accordingly the discrete version 
of the test statistic is 


M-1 
Cr = DU IRS TSP (3.55) 
k=0 


In CSD, the test statistic is compared with a threshold to make a decision. Intuitively 
the threshold should be related to noise power. Due to the difficulty in acquiring the 
accurate noise power in practice [7, 46, 47], we can use the maximum likelihood 
estimation of the noise power. The maximum likelihood estimation of the noise 
power is 


N-1 
1 
a2 2 
ô, = N 2 ly(nT;)| (3.56) 


The threshold is thus chosen as BG; , where £ is a scalar to meet the pre-defined 
probability of false alarm. 

There are other different test statistics and decision rules (thresholds) for the 
CSD. Especially, if the signal has cyclostationarity at multiple cyclic frequencies, 
how to use them to form a single test statistic is an interesting problem. In [48, 49], a 
general structure based on the GLRT principle is proposed to use the multiple cyclic 
frequencies. However, the method needs very high complexity and also some priori 
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information on the channel. Some simplified approaches have also been studied [50]. 
The use of the CSD for ATSC signal is proposed [51]. There are also researches on 
OFDM signal detections using the CSD [50, 52-54]. 

When interference exists, the CSD may still work well as long as the interference 
does not have the same cyclostationary feature as the primary signal. In general, the 
chance that the primary signal and the interference have the same cyclostationary 
feature is slim. That means CSD is robust to interference and noise uncertainty. 
Furthermore, it is possible to distinguish the signal type because different signal may 
have different non-zero cyclic frequencies. 

Although cyclostationary detection has certain advantages, it also has some dis- 
advantages: 


1. The method needs a very high sampling rate; 

2. The computation of SCD function requires large number of samples and thus high 
computational complexity; 

3. The strength of SCD could be affected by the unknown channel [46]; 

4. The sampling time error and frequency offset could affect the cyclic frequencies 
[55, 56], which will be discussed further in the next section. 


3.2.8 Detection Threshold and Test Statistic Distribution 


To make a decision on whether signal is present, we need to set a threshold y for 
each proposed test statistic, such that certain Py and/or Pr, can be achieved. For a 
fixed sample size N, we cannot set the threshold to meet the targets for arbitrarily 
high P4 and low Py, at the same time, as they are conflicting to each other. Since 
we have little or no prior information on the signal (actually we even do not know 
whether there is a signal or not), it is difficult to set the threshold based on P4. Hence, 
a common practice is to choose the threshold based on Pfa under hypothesis Ho. 

Without loss of generality, the test threshold can be decomposed into the following 
form: y = yı Tox), where y; is related to the sample size N and the target Pfa, and 
To(x) is a statistic related to the noise distribution under Ho. For example, for the 
energy detection with known noise power, we have 


TE) = 0, (3.57) 

For the matched-filtering detection with known noise power, we have 
Tox) = oy (3.58) 
In practice, the parameter y; can be set either empirically based on the observations 
over a period of time when the signal is known to be absent, or analytically based 


on the distribution of the test statistic under Ho. In general, such distributions are 
difficult to find, while some known results are given as follows. 
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For energy detection defined in (3.27), it can be shown that for a sufficiently large 
values of N, its test statistic can be well approximated by the Gaussian distribution 
[14, 28], i.e., 

$r N (o? w der Hi 3.59 
NM ED(X) On ym) Under Ho (3.59) 


Accordingly, for given Pr, and N, the corresponding yı can be found as 


= 
y= va ( we (Pie + ) (3.60) 


+00 
Ot) = z5) eo Pay (3.61) 


For the matched-filtering detection defined in (3.37), for a sufficiently large N, 
we have 


where 


1 


Sur (x) ~ N (0, o$) under Ho (3.62) 
Žana Is]? 


Thereby, for given Pfa and N, it can be shown that 


N-1 


vi = Q'(Pra) |X IsI (3.63) 


n=0 


For the GLRT-based detection, it can be shown that the asymptotic (as N —> oo) 
log-likelihood ratio is central chi-square distributed [16]. More precisely, 


21n Teirr(x) ~ x? under Ho (3.64) 


where r is the number of independent scalar unknowns under Họ and H1. For 
instance, if o? is known while R, is not, r will be equal to the number of inde- 
pendent real-valued scalar variables in R,. However, there is no explicit expression 
for yı in this case. 


3.3 Eigenvalue Based Detections 


Eigenvalue based detections (EBD) was first proposed in [47, 57—60]. The method 
was later studied and refined in [19, 61-64]. EBD can be derived from different 
approaches such as the GLRT principle or information theory. Some examples on 
the derivations can be found in [19, 20, 64]. The threshold setting of the EBD needs 
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random matrix theory [47, 57—60]. The EDB methods solve the noise uncertainty 
problem by using statistical covariance matrix to estimate the noise power. The 
method can detect signal without knowing explicit information of the signal. The 
method was also adopted by IEEE802.22 standard as a solution to detect TV and 


wireless microphone signals. 


3.3.1 The Methods 


We consider the same model as defined at the beginning of this chapter. Let N; = 


max(q;;), zero-pad h;;(k) if necessary, and define 


hj(n) s [hij(n), ha; (n), , hm)" 
We have [47] 
x(n) = Hs(n) + n(n) 


A A le! P 
where Hisa ML x (N + PL) (N = D N;) matrix defined as 


j=l 


H © [H;, Hp, ..., Hp], 


hj(0) > ---hj(Nj) O > 0 
H, = j ce or ee 0 
0 O > hj) ++ +++ hj(N;) 


Note that the dimension of H is ML x (N; + L). 
Define the statistical covariance matrices of the signals and noise as 


R, = E(x(n)x‘(n)) 
R, = E(s(n)s"(n)) 
R, = E (n)n (n) 


We can verify that 


R = HR,H' + o Imr 


(3.65) 


(3.66) 


(3.67) 


(3.68) 


(3.69) 
(3.70) 
(3.71) 


(3:72) 


where o? is the variance of the noise, and Iwz is the identity matrix of order M L. 
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Let the eigenvalues of R, and HR, HÝ be A; > A. >--- > Ayz and p1 > pm > 
+++ > pm z, respectively. Obviously, àn = Pn + o7 . When there is no signal, that is, 
s(n) = 0 (then R, = 0), we have A; = Ap =--- = ÀmL = o$. Hence, àı/àmz = 1. 
When there is a signal, if 0; > pmL, we have à1/Ààmz > 1. Hence, we can detect 
if signal exists by checking the ratio A, /Ay,. Obviously, p1 = pmz if and only if 
HR,H* = Aly, where A is a positive number. From the definition of the matrix H 
and R,, itis highly probable that HR, Ht Æ AIy_. In fact, the worst case is R, = oI, 
that is, the source signal samples are iid. At this case, HR,H* = o? HH. Obviously, 
o? HH? = AIyz if and only if all the rows of H have the same power and they are 
co-orthogonal. This is only possible when N; = 0, j = 1,..., P and M = 1, that 
is, the source signal samples are iid, all the channels are flat-fading and there is only 
one receiver. 

Thus, if M > 1 (multiple antennas) or the channel has multiple paths or the 
source signal itself is correlated, the eigenvalues of the R, are not identical, while at 
pure noise case, the R, should have identical eigenvalues. Hence, we can check the 
eigenvalues of R, to see if signal presents. 

In practice, we only have finite number of samples. Hence, we can only obtain 
the sample covariance matrix other than the statistic covariance matrix. The sample 
covariance matrix is defined as 


L—-24N 
det 1 


R,(N) = ~ 2 x(n)x'(n) (3.73) 


n=L—1 


where N is the number of collected samples. Based on the sample covariance matrix 
and its eigenvalues, a few methods have been proposed based on different prospec- 
tives [19, 47, 57-64]. Such methods are called eigenvalue based detections (EBD). 
Here we summarize the methods as follows. 

Let A; > Az > --- > Amz be the eigenvalues of the sample covariance matrix. 


Algorithm Eigenvalue based detections 

Step 1. Compute the sample covariance matrix as defined in (3.73). 

Step 2. Calculate the eigenvalues of the sample covariance matrix. 

Step 3. Compute a test statistic from the eigenvalues. There are different approaches 
to construct the test statistic. A few simple but effective method are as follows: 


1. Maximum eigenvalue to trace detection (MET). The test statistic is 
Tuer = A1/tr(Rx(N)) (3.74) 
where t,(-) is the trace of a matrix, t,(R,(N)) = eer ài. This method is also 


called blindly combined energy detection (BCED) in [60]. 
2. Maximum to minimum eigenvalue detection (MME) [47]. The test statistic is 


Tume = A1/AmML (3.75) 
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3. Arithmetic to geometric mean (AGM) [19]. The test statistic is 


ML 


i ML 1/ML 
Taon = ap 2 (1 n) (3.76) 


Step 4. Compare the test statistic with a threshold to make a decision. 


All these methods do not use the information of the signal, channel and noise power 
as well. The methods are robust to synchronization error, channel impairment, and 
noise uncertainty. 


3.3.2 Threshold Setting 


To find a formula for the threshold is mathematically involved. In general we need to 
find the theoretical distribution of some combination of the eigenvalues of a random 
matrix. There have been some exciting works on this by using the random matrix 
theory [47, 61-63, 65—68]. For simplicity, in the following, we provide an example 
for the maximum eigenvalue detection (MED) with known noise power [59]. At 
this case, we actually compare the ratio of the maximum eigenvalue of the sample 
covariance matrix R, (VV) to the noise power o with a threshold yı. To set the value 
for yı, we need to know the distribution of 4, (N)/ o for any finite N. Fortunately, 
the random matrix theory has laid the foundation to derive the distributions. 

When there is no signal, R, (N) reduces to R, (N), which is the sample covariance 
matrix of the noise only. It is known that R,(N) is a Wishart random matrix [69]. 
The study of the eigenvalue distributions for random matrices is a very hot research 
topic over recent years in mathematics, communications engineering, and physics 
[69-72]. The joint PDF of the ordered eigenvalues of a Wishart random matrix has 
been known for many years [69]. However, since the expression of the joint PDF 
is very complicated, no simple closed-form expressions have been found for the 
marginal PDFs of the ordered eigenvalues, although some computable expressions 
have been found in [73]. Recently, I. M. Johnstone and K. Johansson have found 
the distribution of the largest eigenvalue [70, 71] of a Wishart random matrix as 
described in the following theorem. 


Theorem 3.1 Let A(N) = XR, (N), u=(4N-=1+4M?,andv=(¥4N-=1+ 
1 1 51⁄3 : M Amax(A(N))— 
Vv M)( + Ja?) . Assume that Jim y (0 < y < 1). Then, i 


JNT NT 
converges (with probability one) to the Tracy-Widom distribution of order 1 [74, 
75]. 


3.3 Eigenvalue Based Detections 61 


Table 3.1 Numerical table for the Tracy—-Widom distribution of order 1 
t —3.90 3.18 2.78 1.91 1.27 0.59 | 0.45 0.98 2.02 


F\(t) 0.01 0.05 0.10 0.30 0.50 0.70 | 0.90 0.95 0.99 


The Tracy—Widom distribution provides the limiting law for the largest eigenvalue 
of certain random matrices [74, 75]. Let F; be the cumulative distribution function 
(CDF) of the Tracy—Widom distribution of order 1. We have 


1 CO 
F(t) = exp (-; f (qu) + (u — 1)4? u) du) (3.77) 


where q (u) is the solution of the nonlinear Painlevé II differential equation given by 
q" (u) = uq (u) + 2q° (u) (3.78) 
Accordingly, numerical solutions can be found for function F; (t) at different values 


of t. Also, there have been tables for values of F(t) [70] as shown in Table 3.1. 
Using the above results, we can derive the probability of false alarm as 


Pfa = P (A1 (N) > vioz) 


a e a ra a E rey 
v 


v v 


Thus we have 


N= 
F, (===) m1 Pra (3.80) 
v 
or equivalently, 
N — 
mE ~ FT! (1 Pe) (3.81) 


From the definitions of u and v in Theorem 3.1, we finally obtain the value for y; as 


(VN + /M)? O/N 44/My?? 
yi ————— |! (1 — Pra) 


a ane (3.82) 


Note that yı depends only on N and Pfa. A similar approach like the above can be 
used for the case of MME detection, as shown in [47, 68]. 

Figure 3.1 shows the expected (theoretical) and actual (by simulation) probability 
of false alarm values based on the theoretical threshold in (3.82) for N = 5000, 
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Fig. 3.1 Comparison of theoretical and actual Pfa 


M = 8, and L = 1. It is observed that the differences between these two sets of 
values are reasonably small, suggesting that the choice of the theoretical threshold 
is quite accurate. 


3.3.3 Performances of the Methods 


To show the performance and the robustness of the methods, here we give some 
simulation results for the EBDs. Comparison with the energy detection (ED) is also 
included. We consider two cases here: the signal is time uncorrelated and the signal 
is time correlated. The Receiver Operating Characteristics (ROC) curves (P4 versus 
Pfa) at SNR = —15dB, N = 5000, and M = 4 are plotted at the two cases. The 
performance at first case in shown in Fig. 3.2 with L = 1 and that at the second case 
is shown in Fig. 3.3 with L = 6, where “ED-udB” means energy detection with u 
dB noise uncertainty. In Fig. 3.3, the source signal is the wireless microphone signal 
[76] and a multipath fading channel (with eight independent taps of equal power) 
is assumed. For both cases, MET, MME and AGM perform better than ED. MET, 
MME and AGM are totally immune to noise uncertainty. However, the ED is very 
vulnerable to noise power uncertainty [4—6]. 

Obviously the eigenvalue based detections do not use the information of the signal, 
channel and noise power as well. The methods are robust to synchronization error, 
channel impairment, and noise uncertainty. However, like other blind detections, the 
methods are vulnerable to unknown narrowband interferences. 
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Fig. 3.2 ROC curve: i.i.d source signal 


Probability of detection 
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Fig. 3.3 ROC curve: wireless microphone source signal 


3.4 Covariance Based Detections 


Covariance based detections (CBD) was first proposed in [65, 77]. The method 
solved the noise uncertainty problem by using the online estimated noise power. The 
method can detect signal without knowing explicit information of the signal. The 
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method was also adopted by IEEE802.22 standard for detecting TV signal and as 
the first choice for sensing the wireless microphone signals. 


3.4.1 The Methods 


As shown in the last section, the covariance matrix of the received signal can be 
written as 


R, = HR,H! + of Iu (3.83) 


If the signal s(n) is not present, R, = 0. Hence the off-diagonal elements of R, are 
all zeros. If there is signal and the signal samples are correlated, R, is not a diagonal 
matrix. Hence, some of the off-diagonal elements of R, should be non-zeros. 

In practice, the statistical covariance matrix can only be calculated using a limited 
number of signal samples. For notation simplicity, here we consider the case of single 
antenna/sensor M = 1, and drop the indices for antenna/sensor. Define the sample 
auto-correlations of the received signal as 


oS 
r= N, D 1), 2=0,1,...,L-1 (3.84) 
where x (m) is the received signal samples, and N, is the number of available samples. 
The statistical covariance matrix R, can be approximated by the sample covariance 
matrix R,(N,) as defined in the last section. At M = 1, R,(N;) can be formed by 
the auto-correlations r(/). Note that the sample covariance matrix is symmetric and 
Toeplitz. 

Based on the generalized likelihood ratio test (GLRT) or information/signal pro- 
cessing theory, there have been a few methods proposed based on the sample covari- 
ance matrix. One class of such methods is called covariance based detections (CBD) 
[1, 65, 76, 77]. Some methods that directly use the auto-correlations of the signal can 
also be included in this class [78]. The covariance based detections directly use the 
elements of the covariance matrix to construct detection methods, which can reduce 
computational complexity. The methods are summarized in the following. 

Let the entries of the matrix R,(N,) be Cmn (m,n = 1,2,..., ML). 


Algorithm Covariance based detections 
Step 1. Compute the sample covariance matrix R,(N;) as defined in (3.73). 
Step 2. Construct a test statistic directly from the entries of the sample covariance 
matrix. In general, the test statistic of the CBD is 


Tegep = F, (Cnn) /F2(Cmm) (3.85) 
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where F; and F are two functions. At single antenna/sensor case, it can be written 
equivalently as 


Topp = Fi(r(0),...,r(Z — 1))/F2(r (0), ...., r(Z — 1)) (3.86) 


There are many ways to choose the two functions. Some special cases are shown in 
the following. 


1. Covariance absolute value detection (CAVD). The test statistic is 


ML ML ML 


Tcavo = X X |cmn|/ > Gun (3.87) 


m=1 n=1 m=1 


2. Maximum auto-correlation detection (MACD). The test statistic is 


ML 
Tuacp = max |Cnn|/ X lcnn! (3.88) 
m=1 


3. Fixed auto-correlation detection (FACD): The test statistic is 


ML 
Tracp = |Cmonol/ X |Cmml (3.89) 


m=1 


where mo and no are fixed numbers between 1 and M L. At single antenna case, 
the detection can be written equivalently as 


Traco = |r (lo)|/r (0) (3.90) 


This detection is especially useful when we have some prior information on the 
source signal correlation and knows the lag that produces the maximum auto- 
correlation. For example, it can be used for detect the OFDM signal by using the 
CP or pilot property [52]. 


Step 3. Compare the test statistic with a threshold to make a decision. 


All these methods do not use the information of the signal, channel and noise power 
as well. The methods are robust to synchronization error, channel impairment, and 
noise uncertainty. 

The test statistic is compared with a threshold y to make a decision. The threshold 
y is determined based on the given Pfa. To find a formula for the thresholds is math- 
ematically involved [65, 77]. We will show an example for M = 1 in the following 
subsection. 
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The computational complexity of the algorithm is as follows (for M = 1). Com- 
puting the auto-correlations of the received signal requires about L N, multiplications 
and additions. Computing Tı (N,) and T2 (N,) requires about L? additions. Therefore, 
the total number of multiplications and additions is about LN; + L’. 


3.4.2 Detection Probability and Threshold Determination 


It is generally difficult to find closed-form detection probabilities. For this purpose, 
we need to find the distribution of test statistics. In [65, 76, 77], approximations for 
the distribution of the test statistics has been found by using central limit theorem for 
M = 1. Furthermore, the theoretical estimations for the two probabilities, P4, Pra, 
as well as the threshold associated with these probabilities, were also discussed. Here 
we summarize the results as follows. 

In the following, we consider the case of M = 1. Denote cy as the element of 
sample covariance matrix R,(N,) at the nth row and mth column, and let 


L L 
1 
Tı (Ns) = L 22 Cnm (3.91) 
re 
T(Ns) = L 2 |Cnn (3.92) 
The test statistic of the CAVD is then Tceavp = Ti(Ns)/T2(Ns).- 


It is shown in [65, 76, 77] that 


202 
, S 2 sS 
dim EITI (N,)) = 0) +0, + = de — Djal (3.93) 
where 
a, = E[s(n)s(n — 1)|/o2 (3.94) 


g? is the signal power, o? = E[s?(n)]. |a| defines the correlation strength among 
the signal samples, here 0 < |œ;| < 1. For simplicity, we denote 


2 L-1 
A 
Ge Ài — 1)|a| (3.95) 


which is the overall correlation strength among the consecutive L samples. When 
there is no signal, we have 
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T) (Ns)/T2(Ns) © ET (Ns))/E(T2(Ns)) = 1+ (L — I) 


(3.96) 


T S 
Note that this ratio approaches to 1 as N, approaches to infinite. Also note that the 
ratio is not related to the noise power (variance). On the other hand, when there is 


signal (signal plus noise case), we have 


T(Ns)/T2(Ns) © ET (Ns))/E(2(Ns)) 


mw 1+ oe pee ey (3.97) 
C o2+o2 " O SNR+1 * 


Here the ratio approaches to a number larger than 1 as N, approaches to infinite. The 
number is determined by the correlation strength among the signal samples and the 
SNR. Hence, for any fixed SNR, if there are sufficiently large number of samples, 
we can always differentiate if there is signal or not based on the ratio. 

However, in practice we have only limited number of samples. So, we need to 
evaluate the performance at fixed N,. 

First we analyze the Pfa at hypothesis Ho. For given threshold y, the probability 
of false alarm for the CAVD algorithm is 


1 2 
Pra =P (T, (Ns) > M112(Ns)) x P (no ET ( +(L-1) Je;) 
yı \ Nsw 


1 2 
T,(N,) — 0? L(+@-) mz)! 


< 
Jee TR 


1 2 
+ (14-1) wz) -! 


zx 1 3.98 
Z/N, GANA 
where 
N ere (3.99) 
Q(t) = — | e`" -du : 
NVT Jt 
For a given Pfa, the associated threshold should be chosen such that 
1 2 
1 (1+@-) we)-1 a acs ii 
Z/N; K l 
That is, 
1+- 1a 
i (3.101) 


y= 
1- OP) 
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Note that here the threshold is not related to noise power and SNR. After the 
threshold is set, we now calculate the probability of detection at various SNR. For 
the given threshold yı, when signal presents, 


1 
Pa = P(T\(Ns) > V1 T2(Ns)) = P (nwo < Enw) 


1 
x P (nov < ~E(TN.)) 


=» (ar ran 


/ Var (To (N,)) x / Var (Ty(Ns)) 


ZETI (Ns) — o? — o; 
= (3.102) 
Var (72(Ns)) 
For very large N, and low SNR, we have 
202 2(02 +07) 
Var (T>(N,)) © 7 (207 +o) 7x a (3.103) 
and 
E(T\(N,)) © 0, +0, +0; T1 (3.104) 


Hence, we have a further approximation 


Arar ea 1 SNR 
nit vio; +o) f =1-Q (2 + GNRED -) 


2/Ns 2/Ns 


Py Xl Q 
(3.105) 


Obviously, the P4 increases with the number of samples, N,, the SNR and the cor- 
relation strength among the signal samples. Note that yı is also related to N; as 


shown above, and lim yı = 1. Hence, for fixed SNR, P; approaches to 1 when N, 
sy Co 


approaches to infinite. 


3.4.3 Performance Analysis and Comparison 


To compare the performances of any methods, first we need a criterion. By properly 
choosing the thresholds, many methods can achieve any given P4 and Pr, > 0 if 
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sufficiently large number of samples are available. The key point is how many samples 
are needed to achieve the given P4 and Pfa > 0. Hence, we choose this as the criterion 
to compare the two algorithms. 

For a target pair of Py and Pfa, based on (3.105) and (3.101), we can find the 
required number of samples for the CAVD as 


y (OHP ja) — QOPA) + (L = DVT) 


Ne 
(Y1SNR)? 


(3.106) 


For fixed Py and Pfa, Ne is only related to the smoothing factor L and the overall 
correlation strength Yz. Hence, the best smoothing factor is 


Loest = min{ Ne} (3.107) 


which is related to the correlation strength among the signal samples. 

Here we give a comparison of the CBD with the energy detection. Energy detection 
simply compares the average power of the received signal with the noise power to 
make a decision. To guarantee a reliable detection, the threshold must be set according 
to the noise power and the number of samples [4—6]. On the other hand, the proposed 
methods do not rely on the noise power to set the threshold (see Eq. (3.101)), while 
keeping other advantages of the energy detection. Simulations have shown that the 
proposed method is much better than the energy detection when noise uncertainty 
is present [65, 76, 77]. Hence, here we only compare the proposed method with the 
ideal energy detection (assume that noise power is known exactly). 

For energy detection, the required number of samples is approximately [5] 


("Ppa — OP)” 


Ne = 3.108 
SNR? ) 
Comparing (3.106) and (3.108), if we want Ne < Ne, we need 
L-1 
Yr >1+ (3.109) 


Vm (Q7' (Pra) — Q7! (P3) 


For example, if Py = 0.9 and Pfa = 0.1, we need Yz > 1+ fot. In conclusion, if 
the signal samples are highly correlated such that (3.109) holds, the CAVD is better 
than the ideal energy detection; otherwise, the ideal energy detection is better. 

In terms of the computational complexity, the energy detection needs about N, 
multiplications and additions. Hence, the computational complexity of the proposed 
methods is about L times that of the energy detection. 
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3.5 Cooperative Spectrum Sensing 


When there are multiple secondary users/receivers distributed at different locations, 
it is possible for them to cooperate to achieve higher sensing reliability. There are 
various sensing cooperation schemes in the current literature [28, 29, 41, 79-92]. In 
general, these schemes can be classified into two categories: (A) Data fusion: each 
user sends its raw data or processed data to a specific user, which processes the data 
collected and then makes the final decision; and (B) Decision fusion: multiple users 
process their data independently and send their decisions to a specific user, which 
then makes the final decision. 


3.5.1 Data Fusion 


Theoretically, the LRT based on the multiple sensors is the best. However, there 
are two major difficulties in using the optimal LRT based method: (1) it needs the 
exact distribution of x, which is related to the source signal distribution, the wireless 
channels, and the noise distribution; (2) it may needs the raw data from all sensors, 
which is very expensive for practical applications. 

In some situations, the signal samples are independent in time, that is, E(s; (n) 
s;(m)) = 0, for n Æ m. If we further assume that the noise and signal samples have 
Gaussian distribution, i.e., n(n) ~ N(0, R,) and s(n) ~ N(O, Rs), where 


R, = E(s(n)s"(n)), Ry = E (mn (n)) (3.110) 
the LRT can be obtained explicitly as [89] 


N-1 


1 
log TRT = x 5 x" (RI'R, R, + R, x(n) (3.111) 
n=0 


Note that in general the cross-correlations among the signals from different sensors 
are used in the detection here. It means that the fusion center needs the raw data from 
all sensors, if the signals from different sensors are correlated in space. The reporting 
of the raw data is very expensive for practical applications. 

If the sensors are distributed at different locations and far apart, the primary signal 
will very likely arrive at different sensors at different times. That is, in (3.3) tix may 
be different for different i. For example, assuming that we are sensing a channel with 
6 MHz bandwidth with sampling rate 6 MHz, delay of one data sample approximately 
equals to 50 m distance. In a large size network like a 802.22 cell (typically with radius 
30km), the distance differences of different sensors to the primary user could be as 
large as several kilo-meters. Therefore, the relative time delays t;, can be as large 
as 20 samples or more. If the delays are different, the signals at the sensors will be 
independent in space. 
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For distributed sensors, their noises are independent in space. If we aim for sensing 
at very low SNR, the received signal at a sensor will be dominated by noise. Hence 
even if the primary signals at different sensors may be weakly correlated, the whole 
signals (primary signals plus noises) can be treated approximately as independent in 
space at low SNR. So, in the following, we further assume that E(s;(n)s;(n)) = 0, 
fori Æ j. 

Under the assumptions we have 


R, = diag(o; 4,- Of y) (3.112) 
R, = diag(of;, ..., o2 m) (3.113) 


where a2; = E(\n;(n)|7) and oe; = E(\s;(n)|?). Under the assumptions, we can 


express the LRT equivalently as 


ae o. M Vi 
log Tirr = — —— __|x;(n)|? = “Trp; (3.114 
g TERT ÈL GE ey) (n)| Do Tey (3.114) 
where 
1 N-1 
— , 2 
TEDi = A 2 Ix; (n)| (3.115) 


and y; = GPG, x. 

Note that Tgp; is the normalized energy at sensor i. The LRT is simply a linearly 
combined (LC) cooperative sensing. This method is also called cooperative energy 
detection (CED), which combines the energy from different sensors to make a deci- 
sion. Thus there are three assertions for cooperative sensing by distributed sensors 
with time independent signals: 


1. the optimal cooperative sensing is the linearly combined energy detection; 

2. the combining coefficient is a simple function of the SNR at the sensor; 

3. a sensor only needs to report its normalized energy and SNR to the fusion center, 
and no raw data transmission is necessary. 


If the signals are time dependent, the derivation of the LRT becomes much more 
difficult. Furthermore, the information of correlation among the signal samples is 
required. There have been methods to exploit the time and space correlations of the 
signals in a multi-antenna system [14]. If the raw data from all sensors are sent to the 
fusion center, the sensor network may be treated as a single multi-antenna system 
(virtual multi-antenna system). If the fusion center does not have the raw data, how 
to fully use the time and space correlations is still an open question, though there 
have been some sub-optimal methods. For example, a fusion scheme based on the 
CAVD is given in [87], which has the capability to mitigate interference and noise 
uncertainty. 
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A major difficulty in implementing the method is that the fusion center needs to 
know the SNR at each user. Also the decision and threshold are related to the SNR’s, 
which means that the detection process changes dynamically with the signal strength 
and noise power. 

If P = 1, the propagation channels are flat-fading (qik = 0, Vi, k), and Tig = 
0, Vi, k, the signal at different antennas can be coherently combined first and then the 
energy detection is used [28, 31, 93]. The method is called maximum ratio combined 
(MRC) cooperative energy detection. 


1 N-1 M 
Turc = 3 9) 12 hi? (3.116) 


n=0 i=l 


It is optimal if the noise powers at different sensors are equal. Note that the MRC 
needs the raw data from all sensors and also the channel information. 

We have proved that the LRT is actually a LC scheme. It is natural to also consider 
other LC schemes. In general, a LC scheme simply sums the weighted energy values 
to obtain the following test statistic 


M 
Tic = Xo gi TED, i (3.117) 


i=1 


where g; is the combining coefficient with g; > 0. If we allow the combining coef- 
ficients to depend on the SNRs of sensors, we know that the optimal sensing should 
choose g; = y;/(1 + yi). So the problem is how we design a LC scheme that does not 
need the SNR information or only uses partially available SNR information, while 
its performance does not degrade much. 

One such scheme is the equal gain combine (EGC) [14, 28, 83, 84, 93, 94], i.e., 
gi = 1/M for alli: 


M 
1 
Tecc = u 2 TED,i (3.118) 


EGC totally ignores the differences of sensors. 

If the normalized signal energies at different sensors have large differences, a 
natural way is to choose the largest normalized energy for detection. We call this 
maximum normalized energy (MNE) cooperative sensing. The test statistic is 


TMNE = max TED, i (3.119) 


Note that this is different from the method that uses the known sensor with the 
largest normalized signal energies. The largest normalized energy may not always 
be at the same sensor due to the dynamic changes of wireless channels. The method 
is equivalent to the “OR decision rule” [79, 86]. 
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There have been many researches for the “selective energy detection”. Such meth- 
ods select the “optimal” sensor to do the sensing based on different criterias [41, 
90-92, 95-98]. 


3.5.2 Decision Fusion 


In decision fusion, each sensor sends its one-bit (hard decision) or multiple-bit deci- 
sion (soft-decision) to a central processor that deploys a fusion rule to make the final 
decision. 

Let us consider the case of hard decision: sensor i sends its decision bit u; (“1” 
for signal present and “0” for signal absent) to the fusion center. Let u be the vector 
formed from u;. The test statistic of the optimal fusion rule is thus the LRT [79]: 


pul) 
T Be o 3.120 
DFLRT puo) ( ) 


Assuming that the sensors are independent, we have 


M 
p(uilFh) 
T = ee 121 
DFLRT L1 panmi (3.121) 


Let A, be the set of i such that u; = 1 and Ag be the set of i such that u; = 0. The 
above expression can be rewritten as 


M P M 
d,i = Pai 
T = 3.122 
DFLRT NG oe lease (3.122) 


icA; 


where Pz; and Pfa; are the probability of detection and probability of false alarm 
for user i, respectively. Taking logarithm, we obtain 


Pai Le Pai 
log TpFLRT = 5> log 5 P, Se isn (3.123) 
icA] a, i a, i 


By ignoring some constants not related to u;, the expression can be rewritten as 


M 


log TDFLRT = 5 Ui log 
i=l 


(3.124) 


The test statistic is a weighted linear combination of the decisions from all sensors. 
The weight for a particular sensor reflects its reliability, which is related to the 
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status of the sensor (for example, signal strength, noise power, channel response, 
and threshold). 

If all sensors have the same status and choose the same threshold, the weights are 
equal and therefore the LRT is equivalent to the popular “K out of M” rule: if and 
only if K decisions or more are “1’’s, the final decision is “1”. This includes “Logical- 
OR (LO)” (K = 1), “Logical-AND (LA)” (K = M) and “Majority” (K = (41) as 
special cases [79]. Let the probability of detection and probability of false alarm of 
the method are respectively 


M 
Pi = ds (") (1 — Pai) Pii (3.125) 


and 


M 


M M-i yi 
Pfa = ID ( i ) (1 g Pya,i) Pra (3.126) 


i=K 


While the Neyman—Pearson Theorem tells us that “K out of M” rule is optimal 
(for equal sensors case), it does not stipulate how to choose the threshold t, and K. 
In general, to get the best threshold t, and K we need to solve some optimization 
problems for different purpose. 

If each user can send multiple-bit decision to the fusion center, a more reliable 
decision can be made. A fusion scheme based on multiple-bit decisions is shown in 
[29]. In general, there is a tradeoff between the number of decision bits and the fusion 
reliability. There are also other fusion rules that may require additional information 
[79, 99]. 


3.5.3 Robustness of Cooperative Sensing 


Let the noise uncertainty factor of sensor i be a;. Assume that all sensors have the 
same noise uncertainty bound. For the linear combination, the expectation of noise 
power in Tzc is therefore 


M M 
Sic = > giG,, oi = 6, > 81/0; (3.127) 
i=l i=l 


Hence, the noise uncertainty factor for LC fusion is apc = 1/ > (e/a). Note 
that œ; and 1/æ; are limited in [10~8/!°, 108/10] and have the same distribution. 
Hence ac is also limited in [10~8/!°, 108/!°]. EGC is a special case of LC. Based 
on the well-known central limit theorem (CLT), it is easy to verify the following 
theorem for EGC [56]. 
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Probability of detection 
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Probability of false alarm 


Fig. 3.4 ROC curve for data fusion: N = 5000, u = —15dB, 20 sensors 


Theorem 3.2 Assume that all sensors have the same noise uncertainty bound B 

and their noise uncertainty factors are independent. As M goes to infinite, the noise 

uncertainty factor of EGC a,c converges in probability to a deterministic number 
log(10)B . 

1/E(@;) = ee TT, that is, for any € > 0, 


P (jazrc — 1/E(@;)| > €) = 0 (3.128) 


It means that, as M approaches to infinite, there is no noise uncertainty for EGC 
fusion rule. We can prove similar result for some other data fusion rules. Hence, data 
fusion does reduce the noise uncertainty impact. For example, at N = 5000 and SNR 
u = —15dB, the ROC curve for 20 sensors is shown in Fig. 3.4. 

Although cooperative sensing can achieve better robustness and performance, 
there are some issues associated with it. First, additional bandwidth is required to 
exchange information among the cooperating users. In an ad-hoc network, this is by 
no means a simple task. Second, the information exchange may induce errors, which 
may have a major impact on fusion performance. 


3.5.4 Cooperative CBD and EBD 


As shown in the last sections, CBD and EBD are robust sensing methods that are 
immune to noise uncertainty. Thus it is interesting to use it for cooperative sensing 
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as well. In [87], methods were proposed to use the CBD and EBD for cooperative 
sensing. Here we give a brief review of the methods. 

It is assumed that there are M > 1 sensors/receivers in a network. The sensors are 
distributed in different locations so that their local environments are different and 
independent. Each sensor has only one antenna. Other than the previous model, here 
we consider that the received signal may be contaminated by interference. There 
are two hypothesizes: Ho and H1, which corresponds to signal absent or present, 
respectively. The received signal at sensor/receiver i and time n is given as 


Ho: x(n) = pi(n) + n(n) (3.129) 
Hy: x(n) = his(n — Ti) + p(n) + n: (n) (3.130) 


Here p;(n) is the interference (like spurious signals) to sensor i, which may be 
emitted from other electronic devices due to non-linear Analog-to-Digital Converters 
(ADC) or from other intentional/un-intentional transmitters. Note that interferences 
to different sensors could be different due to their location differences. n;(n) is 
the Gaussian white noise to receiver i. s(n) is the primary user’s signal and h; 
is the propagation channel from the primary to receiver i. t; is the relative time 
delay of the primary signal reaching sensor i. Note that primary signal may reach 
different sensors at different times due to their location differences. In the following 
we consider baseband processing and assume that the signal, noise and channel 
coefficients are complex numbers. 


3.5.4.1 The Methods 
Let the auto-correlation of the signal be 
fi = E(x; (n)xž (n — D), L= 0,1,...,L—1 (3.131) 


where L is the number of lags. Then, at hypothesis Ho, 


AD = fpi (D + ni O (3.132) 

where 
fpi (D = E(o;(n)p; (n — D) (3.133) 
Fyi (D = EC: (n7 (n — D) (3.134) 


Since n; (n) are white noise samples, we have 


Pai O) = opi OHO > 0 (3.135) 


n,i? 


where o? ; is the expected noise power at sensor i. At hypothesis Hı, we have 
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Fil) = [h PAOD + Poi + Fri D (3.136) 

where 
Ê (D = E(s(n)s*(n — 1)) (3.137) 


In practice, there are only limited number of samples at each sensor. Let N be the 
number of samples. Then the auto-correlations can only be estimated by the sample 
auto-correlations defined as 


N-1 


1 
nO = 5 Lae —D, 1=0,1,...,L-1 (3.138) 


It is known that r; (7) approaches to 7; (L) if N is large. Each sensor computes its sample 
auto-correlations r; (/) and then sends them to a fusion center (the fusion center could 
be one of the sensor). The fusion center first averages the received auto-correlations, 


that is, compute 
M 


r() = ind) (3.139) 


i=l 
Then the covariance based detection (CBD) in [65] is used for the detection. Let 


L-1 


T=) > g@MIrO|, =r) (3.140) 


1=0 


where g(/) are positive weight coefficients and g(0) = 1. The decision statistic of 
the cooperative covariance based detection (CCBD) is 


Tecap = T/T» (3.141) 
Let 
1 M 
PO = DAO (3.142) 


i=l 
Then r (l) approaches to 7(/) for large simple size. At hypothesis Ho, 
i i 
PD = 3 DFO + a nO (3.143) 


i=1 i=1 


At hypothesis H1, 
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yee ala i Na 1 E 
RD = pou Jaos m fiO + yaa ini) (3.144) 


i i=1 


Therefore, at hypothesis Ho, 


a gl) E ee ri] oF 7 ea On; 


4 Dih (Fi ) + 03,) 
while at hypothesis Ay, 
Tis gO | DM (PAD + o0) + 4 Ei 02, 


its (PRO + #0) + ozi) 


Unlike white noise, the interference may be correlated in time. Hence it is pos- 
sible that 7, ;(J) 40 for L > 0. However, if we assume that the interferences at 
different sensors are different and independently distributed, it is highly possible 
that A BS Fi (1) (L > 0) will be small. This is proved in [87] for some special 
cases. Thus CCBD does improve the robustness to interference. 

As long as the primary signal samples are time correlated, we have T;/ 7 > 1 at 
hypothesis Hı. Hence, we can use T, / T> to differentiate hypothesis Ho and H1. We 
summarize the cooperative covariance based detection (CCBD) as follows. 


Algorithm Cooperative Covariance Based Detection 
Step 1. Each sensor computes its sample auto-correlations r; (/),/ = 0, 1,..., L — 
1. 
Step 2. Every sensor sends its sample auto-correlations to the fusion center. 
Step 3. The fusion center computes the average of the sample auto-correlations 
of all sensors as described in (3.139). 
Step 4. The fusion center computes two statistics T} and T, as described in (3.140). 
Step 5. Determine the presence of the signal based on 7), Tọ and a threshold y. 
That is, if T;/7> > y, signal exists; otherwise, signal does not exist. 


In Algorithm CCBD, a special choice for the weights is: g(0) = 1, (D) = 
2(L —1)/L 7 =1,..., L — 1). For this choice, it is equivalent to choose T, as the 
summation of absolute values of all the entries of matrix R,, and T, as the summation 
of absolute values of all the diagonal entries of the matrix. 

We can form the sample covariance matrix defined as 


r(0) ---r(L—1) 
R, = : : : (3.147) 
r*(L—1)--- r(O) 
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Based on the analysis above, at hypothesis Ho, Rx is approximately an diagonal 
matrix, while at hypothesis H1, Rx is far from diagonal if the primary signal samples 
are time correlated. 

Based on the sample covariance matrix, the eigenvalue based detections (EBD) 
discussed in the last sections can also be used here. We summarize the cooperative 
eigenvalue based detection (CEBD) as follows. 


Algorithm Cooperative Eigenvalue Based Detection 

Step 1-Step 3. Same as Algorithm CCBD. 

Step 4. Form the sample covariance matrix and compute the maximum eigenvalue 
Cmax, and trace of the matrix R,, denoted as T,. 

Step 5. Determine the presence of the signal based on ¢,,,, and T, and a threshold 
y. That is, if Gnax/T, > y, signal exists; otherwise, signal does not exist. 


3.5.4.2 Comparisons with Other Methods 


There have been extensive studies on cooperative sensing. Some of the methods have 
been discussed in Sect. 3.5.1. Among them, the cooperative energy detection (CED) 
is the most popular method. Here we choose the CED for comparison. 

In general, ED needs to know the noise power. A wrong estimation of noise 
power will greatly degrade its performance [7, 47]. CED improves somewhat but 
still vulnerable to the noise power uncertainty as shown above. Furthermore, when 
unexpected interference presents, CED will treat it as signal and hence gives high 
probability of false alarm. 

Compared with CED, advantages of CCBD/CEBD are: (1) as an inherent property 
of covariance and eigenvalue based detection [47, 65], CCBD/CEBD is robust to 
noise uncertainty; (2) due to the cancellation of auto-correlations at non-zeros lags, 
CCBD/CEBD is not sensitive to interferences; (3) it is naturally immune to wide- 
band interference, since such interferences have very weak time correlations; (4) 
there is no need for noise power estimation at all which reduces implementation 
complexity. 

Compared to single sensor covariance and eigenvalue based detections [47, 65], 
which may be affected by correlated interferences, CCBD/CEBD overcomes this 
drawback by cancelation of the adversary impact in the data fusion. 


3.6 Summary 


In this chapter, spectrum sensing techniques, including classical and newly-developed 
robust methods, have been reviewed in a systematic way. We start with the fundamen- 
tal sensing theories from the optimal likelihood ratio test perspective, then review the 
classical methods including Bayesian method, robust hypothesis test, energy detec- 
tion, matched filtering detection, and cyclostationary detection. After that, robust 
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sensing methods, including eigenvalue based sensing method, and covariance based 
detection, are discussed in detail, which enhance the sensing reliability under hostile 
environment, Finally, cooperative spectrum sensing techniques are reviewed which 
improve the sensing performance through combining the test statistics or decision 
data from multiple senors. It is pointed out that this chapter only covers the basics of 
spectrum sensing, but there are many topics are not covered here, such as wideband 
spectrum sensing [100-103] and compressive sensing [104—107], interested readers 
are encouraged to refer to the relevant literatures. 
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Chapter 4 A) 
Concurrent Spectrum Access get 


Abstract Concurrent spectrum access (CSA), which allows different communica- 
tion systems simultaneously transmit on the same frequency band, has been rec- 
ognized as one of the most important techniques to realize the dynamic spectrum 
management (DSM). By regulating the interference to be received by primary users, 
the secondary users are able to gain continuous transmission opportunity. Without 
the need of frequent spectrum detection and reconfiguration, the CSA has the merit 
of low cost and easy implementation in practice. In this chapter, we will present some 
important CSA models, discuss the key problems existing in these CSA systems, and 
review the techniques to deal with these problems. 


4.1 Introduction 


Compared with the opportunistic spectrum access (OSA), in recent years, the concur- 
rent spectrum access (CSA) has been attracting increasing interests from academia 
and industry [1, 2]. The main reason is three-fold. Firstly, the CSA allows one or 
multiple secondary users (SUs) simultaneously transmit on the primary spectrum, 
provided that the interference to the primary users (PUs) can be regulated. Thus, the 
SUs can transmission continuously regardless whether the PU is transmitting or not. 
Secondly, neither inquiry of geolocation database nor spectrum sensing is needed, 
and thus frequent spectrum reconfiguration can be avoided. This makes the cognitive 
device be with low-cost hardware, which is thus more easier to be deployed. Thirdly, 
the CSA can achieve higher area spectral efficiency due to its spatial reuse of spec- 
trum [3, 4], and therefore, can be used to accommodate the dense wireless traffic in 
host-spot areas. 

To enable CSA, the secondary transmitter (SU-Tx) needs to refrain the interfer- 
ence power produced to primary receiver (PU-Rx) by designing its transmit strategy, 
such as transmit power, bit-rate, bandwidth and antenna beam, according to the chan- 
nel state information (CSI) of the primary and the secondary systems. Mathemati- 
cally, the design problem can be formulated to optimize the secondary performance 
under the restrictions of the physical resource limitation of secondary system and the 
protection requirement of primary system. The physical resource constraint has been 
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taken into consideration in the transmission design for the traditional communica- 
tion system with dedicated operation spectrum [5-7]. While, the additional primary 
protection constraint poses new challenges to the design of both single-antenna and 
multi-antenna CSA systems. 

According to whether the interference temperature is explicitly given, the primary 
protection constraint is rendered in two forms. When the interference temperature 
is given as a predefined value, the primary protection constraint can be explicitly 
expressed as interference power constraint. There are basically two types of inter- 
ference power constraint which are known as peak interference power constraint 
and average interference power constraint [8]. Peak interference power constraint 
restricts the interference power levels for all the channel states, while the average 
interference power constraint regulates the average interference power across all the 
channel states. The peak interference power constraint is more stringent with which 
the PUs can be protected all the time. Thus, it is suitable for protecting the PUs with 
delay-sensitive services. The average interference power constraint is less stringent 
compared with the former one, since it allows the interference power exceed the 
interference temperature for some channel states. Thus, it is suitable to protect the 
PUs with delay-insensitive services. On the other hand, when the explicit interference 
temperature is unavailable, primary performance loss constraint is used to protect 
the PUs [9, 10]. In fact, this is a fundamental formulation of primary protection 
constraint, and can help the SUs to exploit the sharing opportunity more efficiently. 
However, this constraint requires the information including the CSI of the primary 
signal link and the transmit power of the PU, which is hard to be obtained in practice 
due to the lack of cooperation between the primary and secondary systems. 

The research on the CSA system with SUs being equipped with single antenna 
mainly focuses on the analysis of secondary channel capacity. It has been shown 
that the capacity of secondary system with fading channel exceeds that with addi- 
tive white Gaussian noise (AWGN) channel, under the interference power constraint 
[11]. The reason lies in that the fading channel with variation can provide more 
transmission opportunities for the secondary system. For flat-fading channel, the 
secondary channel capacity under the peak and the average interference power con- 
straints are studied in [12], whereas the ergodic capacity and the outage capacity 
under various combinations of the peak/average interference power constraint and 
the peak/average transmit power constraint are studied in [13]. It shows that the 
capacity under the average power constraint outperforms that under the peak power 
constraint, since the former one can provide more flexibilities for the SU transmit 
power design. In [9], the ergodic capacity and the outage capacity under the PU-Rx 
outage constraint are analysed. It shows that to fulfill the same level of outage loss of 
PU-Rx, the SU can achieve larger transmission rate under the PU outage constraint. 
With zero outage loss permitted, the SU still achieves scalable transmit rate with the 
PU outage constraint. In [14], the primary channel information is exploited to further 
improve the secondary performance. To predict the interference power received by 
the PU-Rx, the CSI from the SU-Tx to the PU-Rx, which is referred to as cross chan- 
nel state information (C-CSJ, should be known by the SU-Tx. The mean secondary 
link capacity with imperfect knowledge of C-CSI is addressed in [15]. To protect the 


4.1 Introduction 89 


PU under imperfect C-CSI, it is shown that the interference temperature should be 
decreased, which thus leads to a decrement of secondary link capacity. 

The use of multiple antennas provides both multiplexing and diversity gains in 
wireless transmissions [16, 17]. In particular, its function of co-channel interference 
suppression for multiuser transmission makes it a promising technique to enhance the 
CSA performance [18]. Generally speaking, multiple antennas can provide the SU- 
Tx in an CSA system more degrees of freedom in space, which can be split between 
the signal transmission to maximize the secondary transmit rate and the interference 
avoidance for the PUs. In [19], the multiple-input multiple-output (MIMO) channel 
capacity of the SU in a multi-antenna CSA system has been investigated. It shows 
that the primary protection constraint makes the methods proposed for the tradi- 
tional MIMO system inapplicable for the CR transmit and receive design. Similar 
to the single-antenna CSA, moreover, the C-CSI is critical for the transmit design 
for interference avoidance in the multi-antenna CSA. In [20], it shows that when 
the effective interference channel can be perfectly estimated, the interference power 
received by the PUs can be perfectly avoided via cognitive beamforming. In [21], it 
further shows that the joint transmit and receive beamforming can effectively improve 
the secondary transmit rate by suppressing the interference produced by the PU-Tx. 
The use of multiple antennas also facilitates the multiple access and the broadcasting 
of secondary system [22]. Similar to the single-antenna case, due to the restriction of 
both transmit power and interference power, the transmit and receive design for the 
traditional multiple-access channel and the broadcasting channel in multi-antenna 
system is inapplicable and thus should be revisited [23, 24]. Moreover, the design for 
multi-antenna CSA should take into consideration the uncertainty in the estimated 
channel [25, 26] and the security issue [27, 28]. 

In the remainder of this chapter, we first present the single-antenna CSA system 
and discuss the optimal transmit power design under different types of power con- 
straint to maximize the secondary channel capacity. Then, the multi-antenna CSA 
is discussed and the transceiver beamforming is presented under the condition of 
known and unknown related CSI. After that, the transmit and receive design for the 
cognitive multiple-access channel and the cognitive broadcasting channel are pre- 
sented, which is followed by the discussion of robust design for the multi-antenna 
CSA. As an application of CSA in practice, the spectrum refarming technique is 
presented. Finally, the chapter is concluded with a summary. 


4.2 Single-Antenna CSA 


The simplest but most fundamental CSA system is comprised by a pair of SUs 
and a pair of PUs. Each of the terminals is equipped with single antenna. A single 
narrow frequency band is shared by the primary and secondary transmission. All 
the channels involved in the system are independent block fading (BF) channels. As 
shown in Fig. 4.1, gpp, &ps> &sp and gss denote the instantaneous channel power gains 
from PU-Tx to PU-Rx, PU-Tx to SU-Rx, SU-Tx to SU-Rx, and SU-Tx to SU-Rx, 
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Fig. 4.1 The model of 
single-antenna CSA system 


SU-Tx SURRE 
Desired Signal Interference 
—> ---------- > 


respectively. All the channel power gains are assumed to be independent with each 
other and be ergodic and stationary with continuous probability density function. 
In order to study the limit of the secondary channel capacity, we consider that the 
instantaneous channel power gains at each fading state are available at the SU-Tx. 
The AWGN at the PU-Rx and the SU-Rx is assumed to be independent circularly 
symmetric complex Gaussian variables with zero mean and variance No. We consider 
that the PU-Tx is not aware of the coexistence of SU, and thus adopts fixed transmit 
power P,. Note that in practice, the transmission of SU can be noticed by the PU 
since the interference power received by the PU is increased. To compensate its 
performance loss, the PU can increase its transmit power. Thus, rather than being 
fixed, the PU transmit power can be adaptive according the secondary transmission. 
This property has been utilized in the CR design for indirectly exploiting the primary 
system information [14]. 


4.2.1 Power Constraints 


In this CR system, the SU-Tx needs to regulate its transmit power to protect the PU 
service. There are mainly two categories of power constraints, which are the transmit 
power constraint and the primary protection constraint. 


(1) Transmit Power Constraint 


This is a physical resource constraint that restricts the transmit power of the SU 
according to its power budget. Let v = (gpp; 8ps» &sp» ss), and the SU transmit power 
under v be P(v). Given the maximum peak and average transmit power of the SU 
as Pp and Pay, respectively, the transmit power constraint can be formulated as 
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P(v) 0, Yv (4.1) 
P(v) < Pok, Yv (4.2) 
SLP (v)] < Pav (4.3) 


Equation (4.2) is known as the peak transmit power constraint, which is used to 
address the non-linearity of the power amplifier of SU. Equation (4.3) is known as 
the average transmit power constraint, which describes that the power consumption 
of the SU should be affordable in a long-term sense. 


(2) Primary Protection Constraint 


The transmission of SU is allowed only when the primary service can be well pro- 
tected. Thus, the primary protection constraint should be properly formulated. This 
constraint also differentiates the CR design from the traditional one which is solely 
restricted by the physical resource constraint. Generally, there are two kinds of pri- 
mary protection constraints: 


e Interference power constraint: When the peak or average interference temperature, 
which are respectively denoted by Q x and Qay, can be known by the SU-Tx, the 
primary protection constraint can be expressed as the interference power constraint, 
L.e., 


8P Œ) < Qpk, Vv (4.4) 
U[SspP(v)] < Qav (4.5) 


Equation (4.4) is known as the peak interference power constraint. It can be seen 
that the PU under this constraint can be fully protected at any fading status; thus, 
this constraint is suitable for protecting the delay-sensitive services. Equation (4.5) 
is known as the average interference power constraint. Since this constraint only 
protects the PU in a long-term sense, and there can be cases that the interfer- 
ence power exceeds the interference temperature at some fading states. Thus, it is 
suitable to protect the delay-insensitive services. 

e Primary performance loss constraint: When the peak or average interference tem- 
perature is not available, the primary protection constraint can be formulated as 


Ep S £0, (4.6) 
Arp < do, Yv (4.7) 


IA 


Equation (4.6) is known as the PU outage constraint [29], in which £ọ denotes 
the target outage probability of the PU that should be maintained, and £, is the 
outage probability of PU under the co-transmission of SU. Letting y, be the 
target signal-to-interference-plus-noise ratio (SINR) of the PU, £, can be derived 


8pp Pp 
ZP ON ~ YP 


constraint [10], in which ôo is the maximum rate loss that is tolerable by the PU. 


as Ep = Prf |. Equation (4.7) is known as the primary rate loss 
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Note that in either (4.6) or (4.7), the primary system information, including gpp 
and P, should be known by the SU-Tx. Such information can be transmitted 
from PU to SU if the cooperation between the two systems is available. When 
the inter-system cooperation is unavailable, the authors in [14] propose a scheme 
to allow the SU-Tx send probing signal which triggers the power adaptation of 
primary system. By doing so, the information of primary system can be exploited 
to improve the performance of secondary system. 


Thus, the power constraints of the SU-Tx can be formulated as different combi- 
nations of the transmit power constraint and the primary protection constraint, i.e., 


Fi = {P (v) : (4.1), (4.2), 4.4} 
Fa = {P (v) : (4.1), (4.2), (4.5)} 
F3 = {P (v) : (4.1), (4.3), 4.4} 
Fa = {P (v) : (4.1), (4.3), (4.5)} 
F5 = {P (v) : (4.1), (4.2), (4.6)} 
Fo = {P (v) : (4.1), (4.3), (4.6)} 
Fa = {P (v) : (4.1), (4.2), (4.7)} 
Fg = {P (v) : (4.1), (4.3), (4.7)} 


4.2.2 Optimal Transmit Power Design 


The transmit power of the SU can be optimized to achieve different kinds of secondary 
channel capacity. Here, we discuss the optimization of the SU transmit power for 
maximizing the ergodic capacity and minimizing the outage capacity of secondary 
system under different power constraints, respectively. 


(1) Maximizing Ergodic Capacity 


The ergodic capacity of BF channels is defined as the achievable rate averaged over 
all the fading blocks. Note that the interference from the PU-Tx to the SU-Rx can be 
ignored or treated as AWGN, the ergodic capacity of the secondary system can be 
expressed as 


Cag = E fioe: (1 + s0) ] (4.8) 


where the expectation is taken over v. Then, the achievable ergodic capacity under 
different sets of power constraint can be formulated as 


max Cerg (P4-1) 
P(v)EF; 
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(2) Minimizing Outage Capacity 


The outage capacity of BF channels is defined as the maximum rate that can be 
maintained over the fading blocks with a given outage probability. Equivalently, 
given the outage capacity of the secondary system, denoted by ro, the corresponding 
outage probability can be expressed as 


Pou = Pr flog, (1 + ae are) < n| (4.9) 


Thus, maximizing the outage capacity is equivalent to minimizing the outage prob- 
ability given the target outage capacity, i.e., 


min Pout (P4-2) 
P(vjeF; 


Solving P4-1 and P4-2 gives the following observations. 


e P4-1 and P4-2 have structural optimal solutions. For example, in P4-1, under 
the peak transmit and peak interference power constraints (F1), P(v) = Pp when 


gsp < A . When gsp = Ges , the optimal transmit power follows channel inversion 


with iis i.e., P(v) = on This indicates that deep fading in the interference 
channel is helpful to the secondary performance. Under the average transmit and 
peak interference power constraints (F3), the SU transmit power is capped by a 
and is decided by gsp and gss simultaneously. Specifically, the transmit power ‘is 
higher when the interference channel suffers from deep fading while the secondary 
signal channel is not faded. In P4-2, under the peak transmit and peak interference 
power constraints (F1), P(v) has the truncated channel inversion structure which 
is similar to the conventional fading channel [5]. The difference lies in that the 
condition for channel inversion here is determined by both the secondary signal 
channel and the interference channel, while that in [5] it is determined by signal 
channel solely. Therefore, this power allocation strategy is also referred to as two- 
dimensional-truncated channel-inversion (2D-TCI). 

e For both problems, the average interference power constraint is superior to the peak 
counterpart, as the former one provides more flexibility to the power allocation of 
the SU. Specifically, with the average interference power constraint, more power 
can be used when the interference channel experiences deep fading while the 
secondary signal channel is not faded. 

e For both problems, the primary performance loss constraint is superior to the peak 
interference power constraint, since the SU can transmit more opportunistically 
with the former constraint. Moreover, when no additional outage of the PU is 
allowed, the SU transmission is not possible under the peak interference power 
constraint. However, under the primary performance loss constraint, the SU trans- 
mission is not only allowed, but also sustains capacity increase with the transmit 
power. 
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4.3 Cognitive Beamforming 


The use of multiple antennas in wireless communication can achieve beamform- 
ing gain. Specifically, receive beamforming can suppress interference, while trans- 
mit beamforming can avoid interference. By equipping multiple antennas, the SUs 
can jointly design the transmit precoding and transmit power to effectively balance 
between the interference avoidance to the PU and the performance optimization for 
the secondary link. Such a technique is known as cognitive beamforming (CB). 

A model of CB is shown in Fig.4.2, where an SU-Tx transmits signal to the 
SU-Rx by concurrently sharing the spectrum of primary system in which two PUs 
communicate with each other. The SU-Tx is required to be equipped with more 
than one antennas, and the other terminals can be equipped with one or multiple 
antennas. Let Mı, M2, My, and Ms: be the number of antennas on PU,;, PU2, SU- 
Tx and SU-Rx, respectively. The full-rank transmit beamforming matrix of PU; is 
denoted by A; € C™ix4i where j € {1,2}, d j denotes the corresponding number 
of transmit data streams and 1 < d; < Mj. Then, the transmit covariance matrix 
of PU; can be written as S; = A jA7 . The receive beamforming matrix of PU; is 
denoted by B; € C4ix™i, where j € {1, 2}. The primary terminals are considered to 
be oblivious to the SUs, and treat the interference from the SU-Tx as additional noise. 
In the secondary system, the transmit beamforming matrix of the SU-Tx is denoted by 
the full-rank matrix A, € C™=*4e, where de < My. Then, Se = A-A/ is the transmit 
covariance matrix of the SU-Tx. Finally, H € C™=*Ms denotes the secondary signal 
channel matrix and G; € C™=%Ms denotes the matrix of interference channel from 
the SU-Tx to PU;. 


4.3.1 Interference Channel Learning 


The beamforming design, no matter at the receiver side or the transmitter side, heavily 
relies on channel matrix. The beamforming in the conventional multi-antenna system 
with dedicated spectrum is designed based on the signal channel matrix. However, 
the CB design needs the information of both the secondary signal channel matrix 
and the interference channel matrix from the SU-Tx to the PUs. The CB design with 


Fig. 4.2 A model of 
cognitive beamforming 
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Fig. 4.3 The two-phase 

protocol of learning-based Channel Learning 
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perfect knowledge of interference channel matrix is studied in [30]. However, in 
a CSA network, the primary system is usually legacy that has been deployed and 
operating for a period of time. The primary and secondary systems can also belong 
to different operators. Therefore, although sharing the same spectrum, it is hard for 
the primary system to provide cooperation for the secondary system in terms of 
estimating and sending back the information of interference channel. Thus, the key 
problem for the practical CB is how to obtain the interference channel matrix at the 
SU-Tx. 

To get some knowledge of the interference channel, a viable way is to allow 
the SU-Tx listen to the signal sent by the PUs before its own transmission, and 
estimate the channel from the PUs to the SU-Tx. Since the system operates at time- 
division duplex (TDD) mode, the estimated channel can be treated as the interference 
channel from the SU-Tx to the PUs according to channel reciprocity. This process is 
referred to as channel learning. The learning-and-transmission protocol is illustrated 
in Fig.4.3, in which T is the frame length, t is the time duration used for learning 
the interference channel and the remainder T — t is used for data transmission. 

In the channel learning phase, the SU-Tx listens to the transmission of PUs on 
the spectrum of interest for N symbol periods. The received signal can be written as 


y(n) = GY Ajxj(n) +z), n=1,...,N (4.10) 
where j = | indicates that the signal is transmitted from PU;; otherwise j = 2. The 


vector x(n) contains the encoded signals without power allocation and precoding. 
Then, the covariance matrix of the received signals at the SU-Tx can be derived as 


Q; = Ely(n)(yn))71 = Q + pol (4.11) 


where Q, represents the covariance matrix due to the signals from the two PUs, and 
pol is the variance matrix of AWGN noise. At the SU-Tx, only the sample covariance 
matrix can be obtained, i.e., 


Pee ee 
Q =F P Iwy)" (4.12) 
n=1 


Denote Q, as the estimation of Q, that can be abstracted from Q,. The aggregate 
“effective” channel from both PUs to the SU-Tx can be derived as 


GH. = Q'”? (4.13) 
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It should be noted that the channel which has been estimated is the so called effective 
interference channel (EIC) rather than the actual interference channel. This chan- 
nel propagates interference to both of the PUs. Under the assumption of channel 
reciprocity, EIC from SU-Tx to both PUs can be denoted by Gett. 


4.3.2 CB with Perfect Channel Learning 


In this part, the transmit beamforming at the SU-Tx, including the transmit precoding 
and power allocation, under perfect learning of EIC is discussed. In the EIC learning, 
the noise effect on estimating Q, based on Q, can be completely removed by choosing 
a large enough N, i.e., N — oo. 

To avoid the interference caused by the SU-Tx to both of the PUs, the precoding 
matrix of the SU-Tx should meet 


Ge Ac = 0 (4.14) 


Denote de as the rank of Ge. The eigenvalue decomposition (EVD) of Q, can be 
written as Q, = VV”, where V e C™sxd and Ð is a positive deff X dere diago- 
nal matrix. Letting U € Cs% M-d) satisfies VŽU = 0, the transmit beamforming 
matrix of the SU-Tx can be written as 


A, = UC! (4.15) 


where C}? e C™s-da)xde and d, denotes the number of transmit data streams of 
the SU-Tx. C. satisfies C, > 0 and Tr(C,) < P,, where P, denotes the maximum 
transmit power of the SU-Tx. Equation (4.15) indicates that the design of trans- 
mit beamforming matrix for the CR channel is equivalent to the design of transmit 
covariance matrix C, for an auxiliary multi-antenna channel, i.e., HU, subject to the 
transmit power constraint, i.e., Tr(C,) < P;. This simplifies the design of C,, since 
the existing solutions are available for this well-studied precoder design problem 
(see [31] and the references therein). 

When the conditions AVG; E BjG;, j € {1, 2} hold,’ and one or both of the 
PUs have multiple antennas but transmit only through a subspace of the overall spa- 
tial dimensions, i.e., d; < min{ Mı, M2}, the proposed CB scheme based on (4.15) 
outperforms the “P-SVD” scheme proposed in [30] where G;’s are perfectly known 
by the SU-Tx, in terms of the achievable degree of freedom (DoF) of CR transmis- 
sion. The reason lies in that the G.¢ contains the information of AG Gj. Based on 
the condition Av G; E B;G;, Ge also contains the information of B;G,;. Thus, the 
propose scheme can have a strictly positive DoF even when Mı + M2 > My, pro- 
vided that dı + d2 < Mg. In contrary, the B;G; is unknown in the P-SVD scheme. 


1X C Y means that for two given matrices with the same column size, X and Y, if Xe = 0 for any 
arbitrary vector e, then Ye = 0 always holds. 
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Therefore, the DoF becomes zero when Mı + M2 > Mg. In most practical scenarios, 
it has (dı + d2) < (Mı + M2), and thereby the DoF gain achieved by the proposed 
scheme ((min(M,, — dı — d2)", M,,)) is always no less than the DoF achieved by the 
P-SVD ((min(My, — Mı — M2)*, M,,)). Moreover, the maximum DoF is achieved 
when dı = də = 0, i.e., the PU links are switched off. 


4.3.3, CB with Imperfect Channel Learning: 
A Learning-Throughput Tradeoff 


In this part, the CB with imperfect estimation of EIC due to finite sample size is 
discussed. With finite N, the noise effect on estimating Q, cannot be removed, and 
thus error appears in the EIC estimation. Denote Ga as the estimated EIC with error. 
Recall the two-phase protocol given in Fig.4.3. It can be seen that the number of 
sample size N increases as the learning duration t increases. This improves the esti- 
mation accuracy of Gere, and therefore contributes to the CR throughput. However, 
increasing the learning duration will lead to a decrement of data transmission dura- 
tion, which harms the CR throughput. Given that the overall frame length is limited 
by the delay requirement of the secondary service, there exists an optimal learning 
duration that maximizes the CR throughput. This is the so called learning-throughput 
tradeoff in the CB design. 
To exploit the learning-throughput tradeoff, the optimization problem can be for- 
mulated as 
T-Tt 
max 
T,Ce T 
s.t. Tr(C) < J, C> 0,0<1<T 


log |I + HUC.U"H/p, (P4-3) 


where Û is obtained from Gii, and J is the threshold that considers the interference 
power limit and the transmit power limit. In what follows, we present the imperfect 
estimation of EIC and the derivation of J. 


(1) Imperfect Estimation of EIC 

Since Ga depends solely on Q,, we derive Q, based on Q,, whose EVD is 

Q, = PA (4.16) 
where Ay = Diag(A1, ee ee N Ma) is the eigenvalue matrix of Q,. Then, we con- 
sider two cases: 


e With known noise power: When the noise power po is known, the estimation of 
Q, based on the maximum likelihood criterion can be written as 
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Ô, = T,Diag (ai a eee TES po)*) r (4.17) 


whose rank is å. The first dei columns of T, give the estimate of V, and the last 
Ms — dee columns of T, give U. This will be used to design the CB precoding 
matrix. 

With unknown noise power: When the noise power po is unknown, the noise power 
should be estimated along with Q,. By obtaining po, dir, V and U, the maximum 
likelihood estimate of Q, can be derived as 


Ô, = WDiag (i ay eee ee ôo) vi (4.18) 


which has the same structure with (4.17). 
With Q, being derived, the estimate of EIC can be determined according to (4.13). 
(2) Interference Leakage to PUs 


Since the estimated EIC is imperfect, there will be interference power leaked to the 
PUs. Thus, the power constraint Tr(C,.) < J should consider the interference leakage 
and transmit power limit simultaneously. Based on the CB design in (4.15) with U 
being replaced with U, the precoded transmit signal at the SU-Tx can be written as 
S.(n) = Uc.’ KA (n), n > N. Then, the average interference leakage to PU; can be 
expressed as 


I; = ULIB; G;se(n) l7] (4.19) 


The normalized interference leakage with respective to pọTr(B jB7 ) is then upper 
bounded by 


i = Tr(C,) Amax (Gj G7") 
z aj;N Amin (Aj! Gj G47 A;) 


i (4.20) 


where a; is defined as and Nj is the number of samples during the trans- 


[| 
La 
mission of PU;. The upper bound of the average interference leakage in (4.20) has 
some interesting properties: 


The upper bound is finite, since a; > 0; 

The upper bound is invariant with any scaler multiplication with G;. This means 
that the normalized interference received by each PU is independent with its posi- 
tion. 

The upper bound is inversely proportional to the number of samples and the trans- 
mit power of the PU. Therefore, the PU with longer transmit time within the 
learning duration and/or with higher transmit power will suffer from less interfer- 
ence. This is the main principle based on which the SU-Tx designs a fair transmit 
scheme in terms of distributing the interference among PUs. 
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With the upper bound of interference leakage, the SINR of PU ;, denoted by y;, can be 
derived. Let y = in A i}. The threshold J in the constraint of P4-3 can be derived 
je{l, 


as J = min (P;, yt) with peak transmit power constraint, and J = min (+ P,, yT) 
with average transmit power constraint. 

After U and J are determined, P4-3 can be solved. It can be seen that by intro- 
ducing learning phase before data transmission, the multi-antenna SU-Tx is able to 
estimate the interference channel information which is indispensable for interference 
control, and has a good balance between the interference avoidance and throughput 
maximization. 


4.4 Cognitive MIMO 


In this section, we exploit multi-antennas at the secondary terminals to effectively 
balance between the spatial multiplexing at the SU-Tx and the interference avoidance 
at the PUs. The main challenges to be addressed include: 


e The spatial spectrum design for the SU-Tx under the condition that the secondary 
signal channel and the interference channel are perfectly known; 

e The joint transmit and receive beamforming for the SUs to avoid interference to the 
PUs and suppress interference from the PUs simultaneously, under the condition 
that the secondary signal channel and the interference channel are unknown. 


The model of the cognitive multiple-input multiple-output (MIMO) system is 
shown in Fig.4.4, where a pair of SUs shares the same spectrum with K primary 
users. The number of antennas of PU k is denoted by M;, and the number of antennas 
of the SU-Tx and that of the SU-Rx are denoted by Ms and Ms, respectively. The 
single-band frequency is shared by the primary and secondary systems. H € Cs% Ms 


denotes the secondary signal channel matrix and G; € C™«*™« denotes the interfer- 
ence channel matrix from the SU-Tx to PU,. 
Fig. 4.4 The model of 
cognitive MIMO system 
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4.4.1 Spatial Spectrum Design 


In this part, we discuss the spatial spectrum design for the SU-Tx to optimize the CR 
throughput and avoid the interference to the PUs. To exploit the performance limit, 
we consider that the channel matrices from the SU-Tx to the SU-Rx and that from 
the SU-Tx to each PU are perfectly known by the SU-Tx. Let x(n) be the transmit 
signal vector of the SU-Tx, which has been encoded and precoded. The received 
signal at the SU-Rx can be represented by 


y(n) = Hx(n) + z(n) (4.21) 


where z(n) is the AWGN vector with normalized variance I. Let S be the trans- 
mit covariance matrix of the secondary system. It has S = E[x(n)x(n)”] where the 
expectation is taken over the codebook. Assuming that the ideal Gaussian code- 
book with infinitely large number of codeword symbols is used, it has x(n) ~ 
CN(0,S),n = 1,2,.... Then, by applying EVD, the transmit covariance matrix 
can be written as 


S=V>rv" (4.22) 


where V e C™s x4: is the precoding matrix with VV" = I,andd, < My is the length 
of transmit data stream. d, is usually referred to as the degree of spatial multiplexing 
because it measures the number of transmit dimensions in the spatial domain. When 
d- = 1, the transmit strategy is known as beamforming, while when de > 1, it is 
known as spatial multiplexing. The transmit power of the SU-Tx is limited by its 
power budget P,. Thus, the transmit power constraint can be formulated as Tr(S) < 
P,. Letting gx; € C!*Ms be the channel vector from the SU-Tx to the jth receive 


P T i ; 
antenna of the kth PU, it has G; = [gi ee gi id . Then, two kinds of interference 
power constraint can be formulated: 


Total interference power constraint: If the total interference power received by all 
the receive antennas of each PU is limited, the interference power constraint can 
be formulated as 


Tr(GSG#) < Qk, k=1,..., K (4.23) 


where Qx is the total interference temperature of PU%. 

Individual interference power constraint: If the individual interference power 
received by each antenna of the PU is limited, the interference power constraint 
can be formulated as 


a Ser, < are j= 1,.-., Mk, kK=1,...,K (4.24) 


where qx is the individual interference temperature of PU; on each of its antennas. 
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Then, the problem that aims to maximize the secondary capacity by optimizing 
the spatial spectrum S of the SU-Tx can be formulated as 
max log, |I + HSH” | (P4-4) 


s.t. Tr(S) < P, 
(4.23) or (4.24) 
S>0 


In what follows, we will discuss the solving of P4-4. 


4.4.1.1 One Single-Antenna PU 


When K = 1 and M; = 1, there is only one single-antenna PU in the primary system. 
In this case, the channel from the SU-Tx to the PU is a multiple-input single-output 
(MISO) channel which can be represented as g € C!*™”*. Then, P4-4 can be simpli- 
fied as 


max log |I + HSH” | (P4-5) 
s.t. Tr(S) < P, 

gSg” <q 

S>0 


where q denotes the interference temperature of the PU. To solve this problem, we 
consider the following two cases. 


(1) MISO Secondary Channel, i.e., Mg = 1 
In this case, H can be written as h € C!*™*, and the rank of S is one. This indicates 
that beamforming is optimal for the secondary transmission, and S can be written as 
S = wv”, where v € C™**!, Then, P4-5 can be simplified as 
max log, (1+ ||hv||’) (P4-6) 
v 
s.t. |v? < P, 


Igvl? <q 


(2) MIMO Secondary Channel, i.e., Ms, > 1 


In this case, the rank of S is larger than one, and thus spatial multiplexing is optimal 
instead of beamforming. In general, there is no closed-form solution of the optimal 
S. Thus, two suboptimal algorithms that achieve the closed-form solution of S are 
proposed as follows. 
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D-SVD: 

Direct-channel SVD (D-SVD) method applies singular value decomposition 
(SVD) to the secondary signal channel matrix, which can be expressed as 
H = QA!’U". Thus, the precoding matrix V can be obtained as V = U. Let 
M; = min{Ms, Ms}. The optimal power allocation p = [pi,..., Ms] can be 
obtained by solving 


Ms 
max )-log,(1 + pià) (P4-7) 


i=l 


Ms 
s.t. X pi <P, 
i=l 


Ms 

Saji <q 
i=l 

p>0 


where A; is the diagonal element of A, a; = ||gu; |? and u; is the ith column of U. 
The problem is shown convex and the closed-form optimal p; is given by 


: ae 1 M (4.25) 
i = | —— - , l= 1,..., Ms 3 
k v +i Ài 


where v and u are the nonnegative dual variables associated with the transmit 
power constraint and the interference power constraint, respectively. Therefore, it 
can be seen that by using D-SVD method, the optimal power allocation for the 
MIMO secondary channel follows multi-level water-filling form. 

P-SVD: 

Projected-channel SVD (P-SVD) method applies SVD to the projected channel 
of H, i.e., H, = Hd — &&”) with § = g”/||g||. Applying SVD to H, yields 
H, = Qa? (U_)”. Thus, the precoding matrix V can be obtained as V = U_, 
and the optimal power allocation can be derived as 


1 + 
n= (>) Aad aM, (4.26) 


where A; is the diagonal element of A, and v is the dual variable associated 
with the transmit power constraint. Here we can see that, by using P-SVD, it has 
(U_)”& = 0. Since S = U, X(U_)”, we have gSg” = 0, which indicates that the 
interference power produced to the PU can be perfectly avoided. 
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4.4.1.2 Multiple Multi-antenna PUs 


With multiple PUs which are equipped with single or multiple antennas, the trans- 
mission of the SU-Tx can be designed by considering the following two cases. 


(1) MISO Secondary Channel, Mx = 1 


Since the closed-form solution of the optimal S is hard to achieve in this case, efficient 
numerical optimization method can be proposed to solve the equivalent problem: 


max ||hv]|? (P4-8) 
kd 
s.t. vI? < P, 


IG.vll? < Qr, k=1,..., K 


Although both of the constraints in P4-8 specify convex set of v, the non-convexity 
of the objective function makes the overall problem non-concave in its current form. 
However, we can observe that given any value of 0, e/°v satisfies the constraints of 
P4-8, if v satisfies these constraints. At the meantime, the objective value is main- 
tained. Thus, we can assume that hv is a real number, and P4-8 can be transformed to 


max Re(hv) (P4-9) 
v 
s.t. Im(hv) = 0 
Ivi? < P, 
Gv? < Qr, k=1,..., K 
This problem can be cast as a second-order cone programming (SOCP) [32], which 
can be solved by standard numerical optimization software. 
(2) MIMO Secondary Channel, i.e., Mg, > 1 


In this case, the D-SVD and the P-SVD methods which are proposed for the one 
single-antenna PU can be used. Specifically, the multi-level water-filling power allo- 
cation by using D-SVD in this case becomes 


+ 
1 1 
oe es eee (4.27) 
(- + Dk i Aik jik =) 


where œ; k j = ||8k, ju; \|?. v and ux are the non-negative dual variables associated 
with the transmit power constraint and the interference power constraint for PU;, 
respectively. For P-SVD method, we construct the matrix of channel from the SU-Tx 
to all primary receivers/antennas, denoted as G € C™**™*, by taking each gy, ; as the 


(ai My- + j)th row of the matrix. Then, the SVD of G = [G7, PEI Gy) can 


be expressed as G = Qg ie PUH . Thus, given My > Mx (otherwise, the projection 
will be trivial), the projection of H can be expressed as H, = H(I — UcU# ). 
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Fig. 4.5 The three-phase protocol for the cognitive MIMO system 


4.4.2 Learning-Based Joint Spatial Spectrum Design 


In this part, we investigate the cognitive MIMO by solving the two problems: 


e The secondary signal channel and the interference channel are unknown; 
e The interference from the PUs is suppressed by designing the spatial spectrum at 
the SU-Rx. 


For simplicity, we consider there are two PUs in the primary system, i.e., K = 2, 
and only one of the PUs is located within the coverage of secondary transmission. 
However, the proposed method is applicable without this assumption by using the 
EIC which has been introduced in the previous section. 

To enable the CR transmission, a three-phase protocol is proposed as shown in 
Fig. 4.5, whose interpretation is as follows. 


e Channel Learning Stage: A duration of t; is used for channel learning, in which the 
SU-Tx and SU-Rx gain partial knowledge on the interference channel G; and G2 
via listening to the transmission of the PUs. Specifically, the SUs blindly estimate 
the noise subspace matrix from the covariance matrix of the received signal. It 
should be noted that, due to the finite number of samples, perturbation inevitably 
appears in the noise subspace matrix. 

e Channel Training Stage: Since the secondary signal channel is unknown by the 
SU-Tx, in the training stage with duration of t,, the SUs estimate the channel after 
applying joint transmit and receive beamforming. By considering the interference 
to and from the PUs, the optimal training structure can be derived to minimize 
the channel estimation error. It is noted that the channel to be estimated is not the 
actual channel from the SU-Tx to the SU-Rx, but is the effective channel, which 
contains the information of transmit and receive beamforming matrices and the 
actual signal channel. 

e Data Transmission Stage: With the interference channel information learnt in the 
first stage and the signal channel information estimated in the second stage, the SU- 
Tx transmits signal during the data transmission stage with length of T — Tı — T+. 


It is worth noting that the parameter t; plays an important role in the CR performance. 
Intuitively, a larger t; might be preferred in terms of better space estimation, so 
that the interference to and from the PUs can be minimized. However, increasing 
learning time will decease the data transmission time, if the training duration is fixed. 
This harms the CR throughput. Moreover, taking the interference constraints into 
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consideration during training and data transmitting, the freedom of power allocation 
is reduced. Thus, to investigate the CR performance, the lower bound of the secondary 
ergodic capacity is evaluated, which is related to both the channel-estimation error 
and the interference leakage to and from the PUs [33]. The lower bound of the CR 
ergodic capacity is then maximized by optimizing the transmit power and the time 
allocation over learning, training and transmission stages. A closed-form optimal 
power allocation can be found for a given time allocation, whereas the optimal time 
allocation can be found via two-dimensional search over a confined set [21]. 


4.5 Cognitive Multiple-Access and Broadcasting Channels 


In the previous sections, the CR system under investigation has only one pair of 
SUs. In this section, we present the CR system that contains multiple transmitters 
or receivers, which forms the cognitive multiple-access channel (C-MAC) and the 
cognitive broadcasting channel (C-BC), respectively. 


4.5.1 Cognitive Multiple-Access Channel 


In some practical scenarios, there are multiple SUs concurrently transmit signals to 
their common receiver, such as the base station (BS) in the cellular networks or the 
WiFi access point (AP). Such a secondary system can be modelled as the C-MAC as 
is shown in Fig. 4.6. In this model, N SUs concurrently transmit signals to the BS by 
sharing the primary spectrum. There are K PUs, each of which is equipped with single 
antenna. To enable the multi-access of the SUs, the BS is equipped with M, receive 
antennas. Denote H = [hy,..., hy] € C“*" and H = [hy,..., hg] € C™** as 
the channel matrices from the SUs and the PUs to the BS, respectively. The signal 
vector received by the BS can be written as 


y = Hx+ Hx+z (4.28) 


where x and x are the vectors of transmit signal from the SUs and the PUs, and z is 
the AWGN vector whose entries are assumed to be with zero mean and variance No. 
Then, the following two optimization problems can be formulated. 


(1) Sum-Rate Maximization Problem 


With the aim of maximizing the total transmission rate of all the N SUs, the sum-rate 
maximization problem for the single-input multiple-output multiple-access channel 
can be formulated as 
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Fig. 4.6 The system model 
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U,p 
n=1 
St. Pn < Pr, n=1,...N (4.29) 
gp < Qr, k=1,...,K (4.30) 
where U = [u,,..., Uy] with u; denoting the beamforming vector of SU;, and r; is 


the information rate of SU;. Equation (4.29) is the peak transmit power constraint 
with P, being the maximum allowable transmit power. Equation (4.30) indicates the 
interference power constraints where g is the channel power gain from the SUs to 
PU, and Qx is the interference temperature of PU;,. Using the zero-forcing based 
decision feedback equalizer (ZF-DFE) at the BS and applying QR decomposition to 
the channel matrix H, the channel can be decomposed as independent subchannels, 
each of which is associated with one SU. This receiver can thus be viewed as receive 
beamforming, where the beamforming vector is determined by the QR decomposition 
of H. Thus, only the power vector p is remained to be optimized, and the objective of 


N log (1 + pa), where À, is the effective 


the problem can be rewritten as Jaca 
channel gain. 

In P4-10, if the interference constraints are replaced with the single sum transmit 
power constraint, the optimal power allocation can be derived as the conventional 
water-filling solution. The multiple interference power constraints complicate the 
solving of the problem, and thus, we solve the problem by considering the following 


two cases. 


e Single-PU case: When there is only one PU, and thus there remains one interfer- 
ence power constraint, the optimal power allocation follows water-filling form. 
Different from the conventional water-filling power allocation which has a com- 
mon water level, this solution has different water levels for different SUs. More- 
over, each water level is upper-bounded by the individual maximum allowable 
transmit power. Therefore, this power allocation scheme is also referred to as 
capped multi-level (CML) water-filling. Figure 4.7 gives an example of the CML 
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Fig. 4.7 The CML water cap 
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water-filling, where we can see that the power allocated to each SU is limited by 
the minimum value between its specific water level and the water cap. 

e Multiple-PU case: The method to solve P4-10 with multiple interference con- 
straints is summarized as follows. The method first removes the non-effective 
interference constraints. Suppose m effective constraints remain. It starts with the 
sub-problems with a single interference constraint. For the case of i constraints, we 
select i out of N constraints (thus, there are C}, combinations) and check whether 
the solution of the sub-problems also satisfies the remained (m — i) constraints. 
If yes, this solution is globally optimal; otherwise, we continue to search the case 


of (i + 1). 


(2) SINR Balancing Problem 


Taking the fairness among the SUs into consideration, the SINR balancing problem 
is formulated as 


ix ae Ce (P4-11) 
U,p l<n<N Yn,0 


s.t. (4.29), (4.30) 


where y,,,9 is the target SINR of SU, and y, (u, , p) is the SINR of SU, which can be 
derived as 


AH 
Prt, RrU, 


uy (Diss piRi + Nol + Diet Peka) Un 


Yn Un, P) = (4.31) 


where R; = h; h” 3 R, = hh? and px is the transmit power of PU;. By investigating 
the property of P4-11, we can see that (1) the N power constraints and K interference 
constraints can be equally treated; (2) there is only one dominant constraint in the 
problem, and thus the problem can be decoupled into (N + K) sub-problems each 
of which is with single constraint; (3) the sub-problems can be sequentially solved, 
which profoundly reduces the complexing of the algorithm. In fact, when one solution 
of a sub-optimal problem is obtained, we can check whether it satisfies the other 
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Fig. 4.8 The system model 
of C-BC 


7 
H VY: SU, 


M, antennas 


Y 
VY: SU, 
M, antennas 


Base Station 


M, antennas 


7 


7: SUy 


M y antennas 


constraints. If yes, it can be treated as the global optimum without solving the other 
sub-problems. 


4.5.2 Cognitive Broadcasting Channel 


When a BS is equipped with M, antennas and broadcasts information to N SUs, 
cognitive broadcasting channel (C-BC) is built. A typical C-BC model is shown in 
Fig. 4.8, in which g denotes the vector of channel from the BS to the PU. The SU, 
has M,, antennas. The precoding design for the C-BC is different from that for the 
conventional MIMO-BC, because the transmission of the BS is restricted not only by 
a sum-power constraint, but also by an interference power constraint. In literatures, 
the MIMO-BC precoding design is solved by establishing the BC-MAC duality. 
As one type of BC-MAC duality, the conventional BC-MAC duality is proposed to 
derive the capacity region of MIMO-BC under a sum-power constraint [34, 35]. As 
another type of BC-MAC duality, the minimax duality can obtain any boundary point 
of a broadcasting channel capacity region under the single sum-power constraint or 
multiple linear transmit covariance constraints (LTCC) [36, 37]. For solving the C- 
BC precoding problem which is restricted by both of the sum-power constraint and 
the interference power constraint, the general BC-MAC duality is proposed which 
handles the multiple general LTCCs and simplifies the problem formulation [24]. 
The general LTCC is expressed as 


Tr(QA) < J (2.32) 


where Q is the transmit covariance matrix, A is a positive semidefinite matrix, and 
J is a predefined threshold. The general LTCC includes various practical power 
constraints, such as 


e Total transmit power constraint: if A is an identity matrix; 
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e Individual transmit power constraint: if A is a diagonal matrix in which one of 
the diagonal elements is one and the others are zeros; 

e Interference power constraint: if A = gg" where g is the vector of channel 
response from the SU to the PU. 


Then, the C-BC precoding problem can be formulated with subject to any com- 
bination of the above constraints. For demonstrating how to transform the C-BC 
precoding problem to its dual C-MAC problem, we take the following weighted 
sum-rate maximization problem as an example. 


N 

max Wan (P4-12) 
U; n=1 
N 

s.t. X Tr) <P 


n=1 


N 
X g"Ulg < Q 


n=1 


where r, and w, are the achievable rate and the weight coefficient of SU, , respectively. 
U? denotes the precoding matrix of the BS. By applying the general BC-MAC duality, 
non-negative auxiliary variables g,,q, are introduced, with which P4-12 can be 
transformed to 


N 
min max Wal n 
Gdu UP 
n=1 
N N 
S-t. qu (> Tr(Uy) — P) +q (£ "Ung — o) <0 
n=1 n=1 


Letting J = q;P + qu Q, the equivalent C-BC problem can be written as 


N 
max J Wnfn 
UP 


” n=l 


N N 
S-t. qu Y TU?) +q X g Ug < J 
n=1 


n=1 


based on which the dual C-MAC problem can be written as 
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st. )°Tr(Un)o? < J 


n=1 


where the noise covariance matrix is g,g¢”" + q,I. 


4.6 Robust Design 


The CSI, including the C-CSI and S-CSI, is critical for the CR system to control 
interference and optimize its performance. In practice, the CSI obtained by the SU 
is normally imperfect, for which robust design is needed to be identified so that 
the cognitive transmission strategy is less sensitive to the uncertainty in the CSI. 
In the literature, there are a few of related robust designs. One kind of ideas is 
to design the robust beamforming so that a high probability that the interference 
power constraint is satisfied can be achieved. Another kind of ideas is to model 
the uncertainty in related CSI with boundary and design the robust beamforming to 
guarantee the interference power constraint. In this part, we consider two scenarios, 
i.e., only the C-CSI contains uncertainty [38] and both of the C-CSI and S-CSI 
contain uncertainty [26], respectively. 


4.6.1 Uncertain Interference Channel 


To focus on the uncertainty in the interference channel, we consider that the secondary 
S-CSI is perfectly known by the SU-Tx, and the uncertainty in the interference 
channel is caused by the PU in moving environment or caused by the indistinguishable 
PU-Rx due to mutual transmission between two PUs in TDD mode. In both cases, 
the PU can be protected by considering that the degree of arrival (DoA) varies within 
a certain range. The model of the system can be referred to Fig. 4.9 by letting K = 1 
and N = 1, meaning that there is a single PU and a pair of SU-Tx and SU-Rx. To 
characterize the interference channel, we use the spatial multipath model. Let L and 
6 be the number of multipaths and the DoA of the /th path, respectively. The fading 
coefficient of the /th path can be denoted by a. Then, the channel from the SU-Tx 
to the PU can be expressed as 


L 
g=} malo”) (4.32) 


l=1 
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where a(9) is the steering vector of the Ith path. Note that given the angular 
spread of the PU, denoted by Ag, the range of the DoA can be written as 6 e 
[ð — Ag /2, 6+ Ag /2], where 6 is the nominal DoA with respect ot the SU-Tx 
antenna array. Generally, if the DoA region of the PU, denoted by © = [01, 02], can 
be perfectly known, we can setO — Ag /2 = 0 and ô + Ag /2 = 62. If © is unknown, 
we can choose a larger angular spread for estimating the position of the PU so that 
sufficient protection to the PU can be provided. The rate optimization problem with 
the aim of maximizing the secondary throughput can be formulated as 


max r (P4-13) 
w 
s.t. ja? (0®)w|? < Q, VOW €< © 


2 
Iwt <1 


where r is the downlink rate that achieved by the secondary transmission, which can 
be derived as r = |h” w|?. The first constraint is the interference power constraint 
and the second constraint is the transmit power constraint in which the maximum 
peak transmit power is normalized as one. Thus, similar to P4-8, the problem can be 
transformed to 


max Re[h” w] 
w 
s.t. Im[h” w] = 0, 


ja” (0®)w] < VQ, YI 
Iwi <1 (4.33) 


Such a robust beamforming design can allocate the majority of the SU transmit power 
along the SU-Rx DoA with refraining the transmit power along the DoA of the PU 
below the interference temperature. 


4.6.2 Uncertain Interference and Secondary Signal Channels 


This part discusses the robust beamforming design for a multi-user MISO system to 
address the uncertainty in both of the C-CSI and the secondary S-CSI. Only partial 
knowledge of these channels are available. As shown in Fig. 4.9, the SU-Tx with M 
antennas transmits independent signal to the N SU-Rx’s, each of which is equipped 
with single antenna. The channel from the SU-Tx to the nth SU-Rx is denoted by 
h, € C™*!, The uncertainty in h, is described by the Euclidean ball 


H, = [n : Ih- Îl < ôn} (4.34) 
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Fig. 4.9 The system model for robust design 


where h, is the actual channel to the nth SU-Rx, and 4, > 0 is the radius of the 
Euclidean ball. Then, the channel from SU-Tx to the nth SU-Rx can be modelled as 


h, =h, ta,,n=1,...,N (4.35) 


where a, is anorm-bounded uncertainty vector with |la, || < ôn. Similarly, the channel 
from the SU-Tx to PU; can be modelled as 


g = & +b, K=1,...,K (4.36) 


and the uncertainty set of g} is G,. Denoting the SU-Tx precoding matrix by W = 
[wi,...,Ww] € C**%, the total transmit power of the SU-Tx, denoted by P,;, can be 
derived as E[||x||?7] = a || w,, ||. At the receiver side, the SINR at the nth SU-Rx 
Iwi hn |? 
Not Dinas [Wal Bn? 
by ioe can be derived as ae |wi g|. With T„ and Q, representing the target 
SINR of the nth SU-Rx and the interference temperature of PU;, the beamforming 
design problem can be formulated as 


can be derived as yn = . The interference received by PU;, denoted 


min P, (P4-14) 
WwW 


S.t. Yn = Ty, Yh € H, and Yn 
PK < Qr, Wax € Gy and Vk 


int — 
This problem aims to minimize the transmit power of the SU-Tx with guaranteeing 
the QoS requirement for each SU-Rx and keeping the interference received by each 
PU below its interference temperature. Note that the constraints should be satisfied 
under all possible channel conditions with the bounded uncertainty. In another word, 
the QoS of SUs and the interference constraints should be satisfied for the worst case, 


i.e., the constraints can be transformed as min y, > T,, Yn and max Pk < Ox, Vk. 
h, cH, Be EGk 


Thus, before solving P4-14, the problem min y, and max PE, should be solved first. 
h, cH, BEGk 
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For solving these problems, loose bounds, strict bounds and exact robust methods 
are proposed in [26], which shows that the robust design allows the SU-Tx transmit 
with higher power than the non-robust design, and thus can achieve better secondary 
performance. 


4.7 Application: Spectrum Refarming 


Applying the CSA technique in cellular networks is by no mean a trivial task 
[39]. Although the resource allocation for the traditional cellular networks has been 
extensively investigated both in single-cell [40] and multi-cell scenarios [41], the 
spectrum sharing among cellular networks is challenging due to the additional inter- 
ference power constraint. Moreover, the concrete characteristics of each cellular net- 
work, such as the infrastructure deployment and the radio access technique (RAT) 
profoundly affect the CSA design. Quite a few of literatures have investigated the 
spectrum sharing between systems with the same RAT. For example, an orthogonal 
frequency division multiple access (OFDMA) secondary system shares the spectrum 
of an OFDMA primary system, or both of them are CDMA-based. In fact, due to 
the explosive growth of the fourth generation (4G) wireless traffic, spectrum sharing 
among OFDMA systems will be increasingly difficult as the 4G licensed spectrum 
has been crowded. In addition, since the 4G wireless network outperforms the second 
generation (2G) and the third generation (3G) in terms of peak data rate, latency and 
throughput, the legacy subscribers have been migrating to the 4G cellular networks. 
The out-moving of the legacy users decreases the utilization of the legacy licensed 
spectrum, which thus provides sharing opportunity for the 4G networks. To this 
end, the CSA between different generations of cellular networks, which is known as 
spectrum refarming (SR), attracts more attentions in recent years. 

There are two SR models, i.e., the opportunistic SR model and the concurrent SR 
model, which are developed based on OSA and CSA, respectively. 


e Opportunistic SR allows the OFDMA system dynamically access the spectrum 
hole in the legacy bands. Due to the narrowband nature of global system for mobile 
communications (GSM), the SR on GSM spectrum belongs to this model. As the 
traffic of GSM decreases, there exist idle subbands that can be opportunistically 
accessed. The authors in [42] proposed an Long-Term Evolution (LTE)/GSM SR 
by reserving partial subbands for GSM transmission and controlling the transmit 
power for both GSM and LTE to refrain the inter-technology interference. This 
model was further extended to the heterogeneous cellular networks where the 
OFDMA small cells access the idle spectrum of the GSM macrocell [43]. 

Concurrent SR allows the different generations of networks co-transmit at the same 
legacy band, provided that the primary system can be protected. The SR between 
the OFDMA and CDMA systems belongs to this model, due to the wideband 
nature for both systems. Since the channel destroys the orthogonality among the 
CDMA users, there exists inter-user interference which is related to the number 
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of CDMA users [44]. When the number of CDMA users decreases, each CDMA 
user will experience less inter-user interference. Thus, they can tolerate an amount 
of interference introduced by the OFDMA system, with which the target SINR of 
the CDMA user can be maintained. 


In what follows, we discuss the OFDMA/CDMA concurrent SR. The key challenges 
to be addressed include: (1) Quantification of interference temperature: In related 
literatures, the interference temperature is usually given as a predefined threshold 
without any justification [45, 46]; (2) Joint optimization of the primary and sec- 
ondary resource allocation: By taking the interference from the PU-Tx to the SU-Rx 
into consideration, the primary and secondary power allocation can be jointly opti- 
mized through exploiting the primary inner power control scheme. (3) Robust power 
allocation: Without the information of C-CSI, robust power allocation should be 
designed for the OFDMA system to provide sufficient protection to CDMA users. 
The study also extends to the SR of multi-band CDMA system [47] and the hetero- 
geneous SR systems [48, 49]. 


4.7.1 SR with Active Infrastructure Sharing 


For the easy of deployment, the OFDMA can share the same cell site and same BS 
antenna with the CDMA system, as shown in Fig.4.10 (Scenario I). This kind of 
infrastructure sharing is known as active infrastructure sharing. Take the wideband 
CDMA uplink as an example. In practice, it operates at a 5 MHz bandwidth with the 
chip rate of 3.84 Mcps. The spreading gain can vary from 2 to 256 [50]. The LTE can 
adopt 256 subcarriers when working at 5 MHz mode with subcarrier spacing of 15 
kHz. The sampling rate is thus 15 kHz x 256 = 3.84 MHz that equals the wideband 
CDMA chip rate. Thus, the two systems can easily get synchronized with the same 
clock reference. 


(1) Quantification of Interference Temperature 


To quantify the interference temperature provided by the CDMA users, the SINR of 
CDMA users with the interference from OFDMA system should be derived. Given 
the number of CDMA users (denoted by U) and the spreading gain (denoted by N), 
the SINR of CDMA user is determined by the specific spreading codes assigned 
among users and the instantaneous S-CSI of the CDMA system. Due to the lack of 
cooperation between the CDMA and OFDMA systems, these information is unknown 
by the OFDMA system, and thus it is hard for the OFDMA system to predict the 
CDMA SINR. By considering a large-dimension system where U, N — oo and g 
approaches a finite constant, the SINR of the CDMA users approaches an asymptotic 
value which is independent with the specific codes and instantaneous S-CSI. Thus, 
by limiting the asymptotic SINR to be no less than the target SINR, the closed-form 
interference temperature can be obtained [51]. 
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Fig.4.10 Different scenarios of the concurrent SR. Scenario I: SR with active infrastructure sharing; 
Scenario I: SR with passive infrastructure sharing; Scenario III: SR in heterogeneous networks 


(2) Joint Resource Optimization of CDMA and OFDMA Systems 


Note that the interference temperature of the CDMA system is a function of the trans- 
mit power of the CDMA user. A larger transmit power provides a higher interference 
temperature but also introduces higher interference to the OFDMA user. Thus, there 
exists an optimal CDMA transmit power to maximize the OFDMA throughput. An 
efficient algorithm was proposed in [52] to solve the joint resource optimization of 
the CDMA and OFDMA systems by investigating the convexity of the problem over 
the CDMA transmit power and the OFDMA resource allocation. Moreover, although 
the transmit power of CDMA and OFDMA systems are jointly optimized, it is unnec- 
essary to inform the CDMA user with the optimal value of the transmit power in 
practice. In fact, once the OFDMA system operates with its optimal transmit power 
and subcarrier allocation, so as the CDMA system due to the inner power control of 
the CDMA system. 


4.7.2 SR with Passive Infrastructure Sharing 


Passive infrastructure sharing refers to the sharing of passive elements in their radio 
access networks, such as cell sites. When the SR technique is applied with passive 
infrastructure sharing, the licensed legacy system and the unlicensed system are 
equipped with separate BS antennas, as shown in Fig. 4.10 (Scenario II). Intuitively, 
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this additional BS antenna should bring along more diversity that can be exploited by 
the OFDMA system to improve the refarming performance [11, 53, 54]. However, 
without active participation of the legacy system, it is difficult to obtain the C-CSI, 
which is the necessary information for the OFDMA system to predict the produced 
interference. 

To solve this problem, a robust resource allocation scheme was proposed in [55], 
where the S-CSI of the OFDMA system is used as the C-CSI to predict the interfer- 
ence power. It has been proved that under this scheme, the CDMA service can be 
over-protected, i.e., the actual interference power is always no larger than the inter- 
ference temperature. Furthermore, to fully utilize the interference temperature, an 
iterative resource allocation scheme is proposed which gradually increases the trans- 
mit power of OFDMA users until the actual interference received by the CDMA 
system reaches the interference temperature. 


4.7.3. SR in Heterogeneous Networks 


To provide high throughput and seamless coverage for the wireless communications, 
small cells have been proposed to overlay the existing cellular networks [56]. Con- 
ventionally, small cells are deployed to share the radio spectrum by using the same 
RAT with the macrocell [57, 58]. By doing so, the small cells can offload macrocell 
traffic directly. However, they inevitably introduce interference to the macrocell users 
and thus degrade their performance. To address this problem, SR in heterogeneous 
networks is a viable solution. 

Consider a heterogeneous network as shown in Fig. 4.10 (Scenario IID), where 
multiple OFDMA small cells share the spectrum of CDMA macrocell. Specifically, 
the downlink of small cells share the spectrum used for the CDMA uplink, since the 
uplink traffic of the CDMA system is normally lighter than the downlink. By quan- 
tifying the interference power produced by each small cell, the resource allocation 
problem can be formulated, where the objective is to maximize the total through- 
put of all small cells and the constraints are the total interference power constraint 
and individual transmit power constraint. The problem is transformed to optimize the 
transmit power and the allocation of interference temperature among small cells [48]. 

In practice, due to the limited signaling between the macrocell and the small cells, 
the C-CSI between the small cell BS (SBS) and macrocell base station (MBS) is usu- 
ally absent. Since the C-CSI accounts for the distance-based path loss, the small-scale 
fading and the large-scale shadowing, only the latter two are to be determined, as the 
distance between SBS and MBS is fixed and can be easily known from the global 
geographical information. It is found that the optimal power allocation for the SR 
heterogeneous networks is essentially independent with the fading and shadowing 
components of the C-CSI and is only related to the distance-based path loss. There- 
fore, the need of instantaneous information about the fading and shadowing of C-CSI 
can be avoided. 


4.8 Summary 117 


4.8 Summary 


In this chapter, we have discussed the CSA technique by introducing the single- 
antenna CSA system, the multi-antenna cognitive beamforming, the cognitive MIMO, 
the C-MAC and C-BC, and the robust design for the CSA system. The application 
of the CSA technique to operating the LTE cellular system on the legacy spectrum, 
also known as the spectrum refarming, has been discussed. Several critical problems 
in the CSA have been addressed, including the absence of the interference channel 
and signal channel knowledge, the optimal beamforming and multiplexing, as well 
as the interference avoidance and suppression. 


References 


1. L. Zhang, M. Xiao, G. Wu, M. Alam, Y.-C. Liang, S. Li, A survey of advanced techniques for 
spectrum sharing in 5g networks. IEEE Wirel. Commun. 24(5), 44-51 (2017) 

2. L. Zhang, Y.-C. Liang, M. Xiao, Spectrum sharing for internet of things: a survey. IEEE Wirel. 
Commun. 26(3), 132-139 (2019) 

3. Y. Kim, T. Kwon, D. Hong, Area spectral efficiency of shared spectrum hierarchical cell 
structure networks. IEEE Trans. Veh. Technol. 59(8), 4145-4151 (2010) 

4. H.S. Dhillon, R.K. Ganti, F. Baccelli, J.G. Andrews, Modeling and analysis of k-tier downlink 
heterogeneous cellular networks. IEEE J. Sel. Areas Commun. 30(3), 550-560 (2012) 

5. A.J. Goldsmith, P.P. Varaiya, Capacity of fading channels with channel side information. IEEE 
Trans. Inf. Theory 43(6), 1986—1992 (1997) 

6. E. Biglieri, J. Proakis, S. Shamai, Fading channels: information-theoretic and communications 
aspects. IEEE Trans. Inf. Theory 44(6), 2619-2692 (1998) 

7. Y.-C. Liang, R. Zhang, J.M. Cioffi, Subchannel grouping and statistical waterfilling for vector 
block-fading channels. IEEE Trans. Commun. 54(6), 1131—1142 (2006) 

8. R. Zhang, On peak versus average interference power constraints for protecting primary users 
in cognitive radio networks. IEEE Trans. Wirel. Commun. 8(4), 2112-2120 (2009) 

9. X. Kang, R. Zhang, Y.-C. Liang, H.K. Garg, Optimal power allocation strategies for fading 
cognitive radio channels with primary user outage constraint. IEEE J. Sel. Areas Commun. 
29(2), 374-383 (2011) 

10. R. Zhang, Optimal power control over fading cognitive radio channel by exploiting primary 
user CSI. IEEE Glob. Commun., pp. 1-5 (2008) 

11. A.Ghasemi, E.S. Sousa, Fundamental limits of spectrum-sharing in fading environments. IEEE 
Trans. Wirel. Commun. 6(2), 649-658 (2007) 

12. L. Musavian, S. Aissa, Fundamental capacity limits of cognitive radio in fading environments 
with imperfect channel information. IEEE Trans. Commun. 57(11), 3472-3480 (2009) 

13. X. Kang, Y.-C. Liang, A. Nallanathan, H.K. Garg, R. Zhang, Optimal power allocation for 
fading channels in cognitive radio networks: Ergodic capacity and outage capacity. IEEE Trans. 
Wirel. Commun. 8(2), 940-950 (2009) 

14. R. Zhang, Y.-C. Liang, Exploiting hidden power-feedback loops for cognitive radio, in Pro- 
ceedings of IEEE Symposium New Frontiers in Dynamic Spectrum Access Networks (DySPAN) 
(2008), pp. 1-5 

15. H.A. Suraweera, P.J. Smith, M. Shafi, Capacity limits and performance analysis of cognitive 
radio with imperfect channel knowledge. IEEE Trans. Veh. Technol. 59(4), 1811—1822 (2010) 

16. G.J. Foschini, M.J. Gans, On limits of wireless communications in a fading environment when 
using multiple antennas. Wirel. Pers. Commun. 6(3), 311-335 (1998) 


118 4 Concurrent Spectrum Access 


17. L. Zheng, D.N.C. Tse, Diversity and multiplexing: a fundamental tradeoff in multiple-antenna 
channels. IEEE Trans. Inf. Theory 49(5), 1073—1096 (2003) 

18. F. Rashid-Farrokhi, L. Tassiulas, K.J.R. Liu, Joint optimal power control and beamforming in 
wireless networks using antenna arrays. IEEE Trans. Commun. 46(10), 1313—1324 (1998) 

19. R. Zhang, Y.-C. Liang, Exploiting multi-antennas for opportunistic spectrum sharing in cog- 
nitive radio networks. IEEE J. Sel. Top. Signal Process. 2(1), 88—102 (2008) 

20. R. Zhang, F. Gao, Y.-C. Liang, Cognitive beamforming made practical: effective interference 
channel and learning-throughput tradeoff. IEEE Trans. Commun. 58(2), 706-718 (2010) 

21. F. Gao, R. Zhang, Y.-C. Liang, X. Wang, Design of learning-based mimo cognitive radio 
systems. IEEE Trans. Veh. Technol. 59(4), 1707—1720 (2010) 

22. M. Mohseni, R. Zhang, J.M. Cioffi, Optimized transmission for fading multiple-access and 
broadcast channels with multiple antennas. IEEE J. Sel. Areas Commun. 24(8), 1627—1639 
(2006) 

23. L. Zhang, Y. Xin, Y.-C. Liang, H.V. Poor, Cognitive multiple access channels: optimal power 
allocation for weighted sum rate maximization. IEEE Trans. Commun. 57(9), 2066-2075 
(2009) 

24. L. Zhang, R. Zhang, Y.-C. Liang, Y. Xin, H.V. Poor, On gaussian mimo be-mac duality with 
multiple transmit covariance constraints. IEEE Trans. Inf. Theory 58(4), 2064-2078 (2012) 

25. L. Zhang, Y.-C. Liang, Y. Xin, H.V. Poor, Robust cognitive beamforming with partial channel 
state information. IEEE Trans. Wirel. Commun. 8(8), 4143—4153 (2009) 

26. E.A. Gharavol, Y.-C. Liang, K. Mouthaan, Robust downlink beamforming in multiuser miso 
cognitive radio networks with imperfect channel-state information. IEEE Trans. Veh. Technol. 
59(6), 2852-2860 (2010) 

27. Y. Pei, Y.-C. Liang, L. Zhang, K.C. Teh, K.H. Li, Secure communication over miso cognitive 
radio channels. IEEE Trans. Wirel. Commun. 9(4), 1494-1502 (2010) 

28. Q. Xiong, Y.-C. Liang, K.H. Li, Y. Gong, S. Han, Secure transmission against pilot spoofing 
attack: a two-way training-based scheme. IEEE Trans. Inf. Forensics Secur. 11(5), 1017—1026 
(2016) 

29. X. Kang, H.K. Garg, Y.-C. Liang, R. Zhang, Optimal power allocation for ofdm-based cognitive 
radio with new primary transmission protection criteria. IEEE Trans. Wirel. Commun. 9(6), 
2066-2075 (2010) 

30. X. Zhang, D.P. Palomar, B. Ottersten, Statistically robust design of linear MIMO transceivers. 
IEEE Trans. Signal Process. 56(8), 3678—3689 (2008) 

31. A. Paulraj, R. Nabar, D. Gore, Introduction to Space-Time Wireless Commun (Cambridge 
University Press, Cambridge, 2003) 

32. S. Boyd, L. Vandenberghe, Convex Optimization (Cambridge University Press, Cambridge, 
2004) 

33. B. Hassibi, B.M. Hochwald, How much training is needed in multiple-antenna wireless links? 
IEEE Trans. Inf. Theory 49(4), 951-963 (2003) 

34. F. Rashid-Farrokhi, K.J.R. Liu, L. Tassiulas, Transmit beamforming and power control for 
cellular wireless systems. IEEE J. Sel. Areas Commun. 16(8), 1437—1450 (1998) 

35. N. Jindal, S. Vishwanath, A. Goldsmith, On the duality of Gaussian multiple-access and broad- 
cast channels. IEEE Trans. Inf. Theory 50(5), 768-783 (2004) 

36. W. Yu, T. Lan, Transmitter optimization for the multi-antenna downlink with per-antenna power 
constraints. IEEE Trans. Signal Process. 55(6), 2646-2660 (2007) 

37. Yu. Wei, Uplink-downlink duality via minimax duality. IEEE Trans. Inf. Theory 52(2), 361-374 
(2006) 

38. W. Zhi, Y-C. Liang, M.Y.W. Chia, Robust transmit beamforming in cognitive radio networks, 
in 2008 11th IEEE Singapore International Conference on Communication Systems (2008), 
pp. 232-236 

39. S.-Y. Lien, K.-C. Chen, Y.-C. Liang, Y. Lin, Cognitive radio resource management for future 
cellular networks. IEEE Wirel. Commun. 21(1), 70-79 (2014) 

40. S. Sadr, A. Anpalagan, K. Raahemifar, Radio resource allocation algorithms for the downlink 
of multiuser OFDM communication systems. IEEE Commun. Surv. Tut. 11(3), 92—106 (2009) 


References 119 


41. 


42. 


43. 


44. 


45. 


46. 


47. 


48. 


49. 


50. 


51. 


52. 


53. 


54. 


55. 


56. 


57. 


58. 


H. Zhang, L. Venturino, N. Prasad, P. Li, S. Rangarajan, X. Wang, Weighted sum-rate maxi- 
mization in multi-cell networks via coordinated scheduling and discrete power control. IEEE 
J. Sel. Areas Commun. 29(6), 1214—1224 (2011) 

X. Lin, H. Viswanathan, Dynamic spectrum refarming with overlay for legacy devices. IEEE 
Trans. Wirel. Commun. 12(10), 5282-5293 (2013) 

X. Lin, H. Viswanathan, Dynamic spectrum refarming of GSM spectrum for LTE small cells, 
in Proceedings of IEEE Globecom Int, Workshop on Heterogeneous and Small Cell Networks 
(2013) 

S. Verdu, S. Shamai, Spectrum efficiency of CDMA with random spreading. IEEE Trans. Inf. 
Theory 45(2), 622-640 (1999) 

M.G. Khoshkholgh, K. Navaie, H. Yanikomeroglu, Access strategies for spectrum sharing in 
fading environment: overlay, underlay, and mixed. IEEE Trans. Mobile Comput. 9(12), 1780- 
1793 (2010) 

S.M. Almalfouh, G.L. Stuber, Interference-aware radio resource allocation in OFDMA-based 
cognitive radio networks. IEEE Trans. Veh. Technol. 60(4), 1699-1713 (2011) 

S. Han, Y.-C. Liang, B. Soong, S. Li, Dynamic broadband spectrum refarming for ofdma 
cellular systems. IEEE Trans. Wirel. Commun. 15(9), 6203—6214 (2016) 

S. Han, Y.-C. Liang, B.-H. Soong, Spectrum refarming for OFDMA small cells overlaying 
CDMA cellular networks, in Proceedings of IEEE ICCS, special session on Cognitive Cellular 
Networks, Macau (2014) 

J. Tan, Y.-C. Liang, S. Han, G. Yang, On-demand resource allocation for OFDMA small 
cells overlaying CDMA system, in Proceedings of IEEE Global Communications Conference 
(GLOBECOM) (2016), pp. 1-6 

3GPP technical specification group radio access network: physical layer general description, 
3GPP TS 25.201 V10.0.0, 2014 

S. Han, Y.-C. Liang, B. Soong, Spectrum refarming: a new paradigm of spectrum sharing for 
cellular networks. IEEE Trans. Commun. 63(5), 1895-1906 (2015) 

S. Han, Y.C. Liang, B.H. Soong, Joint resource allocation in OFDMA/CDMA spectrum refarm- 
ing system. IEEE Wirel. Commun. Lett. 3(5), 469-472 (2014) 

G. Bansal, M.J. Hossain, V.K. Bhargava, Optimal and suboptimal power allocation schemes for 
ofdm-based cognitive radio systems. IEEE Trans. Wirel. Commun. 7(11), 4710-4718 (2008) 
A.G. Marques, X. Wang, G.B. Giannakis, Dynamic resource management for cognitive radios 
using limited-rate feedback. IEEE Trans. Signal Process. 57(9), 3651-3666 (2009) 

S. Han, Y.-C. Liang, B. Soong, Robust joint resource allocation for ORDMA-CDMA spectrum 
refarming system. IEEE Trans. Commun. 64(3), 1291-1302 (2016) 

H. Claussen, L.T.W. Ho, L.G. Samuel, An overview of the femtocell concept. Bell Labs Tech. 
J. 13(1), 221-245 (2009) 

V. Chandrasekhar, J. Andrews, Spectrum allocation in two-tier networks. IEEE Trans. Commun. 
57(10), 3059-3068 (2009) 

W.C. Cheung, T.Q.S. Quek, M. Kountouris, Throughput optimization in two-tier femtocell 
networks. IEEE J. Sel. Areas Commun. 30(3), 561-574 (2012) 


120 4 Concurrent Spectrum Access 


Open Access This chapter is licensed under the terms of the Creative Commons Attribution 4.0 
International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, 
adaptation, distribution and reproduction in any medium or format, as long as you give appropriate 
credit to the original author(s) and the source, provide a link to the Creative Commons license and 
indicate if changes were made. 

The images or other third party material in this chapter are included in the chapter’s Creative 
Commons license, unless indicated otherwise in a credit line to the material. If material is not 
included in the chapter’s Creative Commons license and your intended use is not permitted by 
statutory regulation or exceeds the permitted use, you will need to obtain permission directly from 
the copyright holder. 


Chapter 5 A) 
Blockchain for Dynamic Spectrum geai 
Management 


Abstract Blockchain is believed to bring new opportunities to dynamic spectrum 
management (DSM). With features of blockchain, the traditional spectrum manage- 
ment method, such as the spectrum auction, can be improved. It can also help to 
overcome the challenges about the security or the lack of incentive mechanisms for 
collaboration in DSM. Moreover, with blockchain, spectrum usage of the DSM sys- 
tem can be recorded in a decentralized manner. In this chapter, we will discuss the 
potentials of blockchain for spectrum management in a systematic way and using 
multiple case studies. 


5.1 Introduction 


Recently, blockchain has received increasing attention, with bitcoin [1] supported 
by it being the most famous cryptocurrency. Blockchain is essentially an open and 
distributed ledger, with some key characteristics such as immutability, transparency, 
decentralization and security. The main idea behind blockchain is to distribute the 
validation authority of the transactions to a community of the nodes and to use 
the cryptographic techniques to guarantee the immutability of the transactions. Far 
from being used only as a ledger, blockchain has been able to support various kinds 
of cyptocurrencies and smart contracts, which autonomously executes agreements 
reached between nodes in blockchain networks. 

The aforementioned characteristics of blockchain make it beneficial in many areas 
in communications. For examples, with the encryption algorithms, blockchain has 
been used to guarantee the integrity of data in the Internet of Things (IoT) [2], 
and with the traceability, blockchain has been used to design a collaborated video 
streaming framework for Mobile Edge Computing (MEC) [3]. Moreover, blockchain 
is seen as a promising technology to achieve more efficient dynamic spectrum man- 
agement (DSM) [4, 5]. According to Federal Communications Commission (FCC), 
blockchain could be used to reduce the administrative expenses of dynamic spectrum 
access systems and thus increase the spectrum efficiency [6]. 

As asecure ledger, blockchain has been introduced to record the spectrum auction 
initiated by the licensed users [7]. With the use of blockchain, spectrum transactions 
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are recorded and maintained by all the users in an immutable and verifiable manner. 
Moreover, a dynamic spectrum access system featuring secure cooperative sensing 
is proposed with the use of blockchain [8]. In such a system, the opportunity of 
spectrum access is first explored by cooperative sensing and the access right is then 
allocated through an auction, with all the information of the spectrum auction being 
securely stored in a blockchain. Besides, the use of a smart contract, which is built 
on the top of blockchain, has also been explored to execute the spectrum sensing 
service provided for secondary users [9]. 

In this chapter, we first give a brief overview of blockchain. Then, from a system- 
atic view, we give some basic principles to illustrate how and why blockchain can 
be used in DSM, and also address the cost and challenges of using the blockchain. 
Several instances of blockchain for DSM are then introduced. Finally, a conclusive 
summary of this chapter is given. 


5.2 Blockchain Technologies 


Blockchain is essentially an open and distributed database maintained by nodes in 
a Peer-to-Peer (P2P) network. When a blockchain is used to record transactions 
between nodes, it can be seen as a distributed ledger. Through cryptographic tech- 
niques, the transactions recorded in a blockchain are tamper-resilient; and by dis- 
tributing copies of the ledger to all the nodes in the network, a blockchain is robust 
to single point of failures compared to a centralized ledger. In this section, we will 
give an overview of the blockchain technology, summarize its features and introduce 
the smart contract, which is an important application of blockchain. 


5.2.1 Overview of Blockchain 


We give an overview of blockchain from the following five aspects, including the 
blockchain structure, consensus algorithm, solution of discrepancy in the nodes, 
digital signature and types of blockchain. Finally, we will illustrate the work flow of 
a blockchain. 

Blockchain Structure: In a blockchain network, transactions are validated by a 
community of nodes and then recorded in a block. As shown in Fig. 5.1, a block is 
composed of a header and a body, in the latter of which the transaction data is stored. 
The block header contains the hash of the previous block, a timestamp, Nonce and the 
Merkle root. The hash value is calculated by passing the header of the previous block 
to a hash function. With the hash of the previous block stored in the current block, 
blockchain is thus growing with new blocks being created and linked to it. Moreover, 
this guarantees that tampering on the previous block will efficiently detected. The 
timestamp is to record the time when a block is created. Nonce is used in the creation 
and verification of a block. The Merkle tree is a binary tree with each leaf node 
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Fig. 5.1 The structure of a Blockchain. A block is composed of a header and a body, where a 
header contains the hash of previous block, a timestamp, Nonce and the Merkle root. The Merkle 
root is the root hash of a Merkle tree which is stored in the block body. We denote a transaction as 
TX and take the 3-th block, which only contains four transactions, as an example to illustrate the 
structure of a Merkle tree 


labelled with the hash of one transaction stored in the block body, and the non-leaf 
nodes labelled with the concatenation of the hash of its child nodes. Merkle root, i.e., 
the root hash of a Merkle tree, is used to reduce the efforts to verify the transactions 
in a block. Since a tiny change in one transaction can produce a significantly different 
Merkle root, the verification can be completed by simply comparing the Merkle root 
instead of verifying all the transactions in the block. 

Consensus Algorithm: As a distinctive feature, blockchain eliminates the need 
for a trusted third-party to validate the transactions. Instead, a consensus is reached 
between all the nodes before a block, recording multiple transactions, is included into 
the blockchain. Essentially, a consensus algorithm is used to regulate the creation 
of a block in an unbiased manner to resist malicious attack. There are different 
consensus algorithms, such as Proof of Work (PoW), Proof of Stake (PoS) and 
Practical Byzantine Fault Tolerance (PBFT), to adapt to the blockchain of different 
types and the performance requirements in different applications. 

PoW is widely used in blockchain networks such as bitcoin. With PoW, a new 
block is created when a random number called Nonce is found. The nonce can be 
verified by checking if the hash of the block header, added with Nonce, satisfy certain 
conditions. Due to the characteristic of hash function, Nonce is easy to verify but can 
only be found by trial and error. Thus, devoting computation resources to find a valid 
Nonce can be seen as a form of work to create a new block. The success of finding 
Nonce is thus the proof of the work one node has done. To incentivize the nodes to 
participate in mining, network tokens and transaction fees will be rewarded to the 
miner which successfully publishes a block. The process of creating a new block is 
thus called mining and the node who participates in mining is called a miner. 

PoS is another consensus algorithm, with the objective to reduce the intensive 
computation in the PoW algorithm. PoS is first used in Peercoin, in which the right 
to publish a new block is still granted by allowing nodes to compete to solve a 
mathematical problem as in PoW, i.e., to find a valid Nonce. However, the difference 
lies in the difficulty of solving the problem, which is inversely proportional to the 
tokens and the holding time of these tokens that a node has. In particular, with 
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more tokens and longer time of holding the tokens, the difficulty of mining for a 
node reduces. Further, the problem-solving process is eliminated in the latter PoS 
algorithms, and the block creator is elected based on the stakes the nodes hold 
[10]. With PoS, the computational resources one node occupies no longer determine 
the probability that it successfully finds a new block, and thus the computational 
resources required to reach a consensus can be largely reduced. 

PBFT [11], is a practical voting-based algorithm that allows a consortium of nodes 
to reach consensus without the assumption of synchronization among them. With a 
Byzantine Fault Tolerance (BFT), nodes can still reach consensus even when there 
are some faulty nodes, i.e., byzantine nodes which can behave arbitrarily. There are 
two kinds of nodes in the PBFT algorithm, including a primary node and backup 
nodes. One node in the network, acting as a client, first issues transactions, as a 
request to the primary node, and the primary node decides the execution order of 
the request and then broadcasts it to all the other backup nodes. After receiving the 
request, the backup nodes check the authentication of the request, decide whether to 
execute the request and send replies to the clients. The consensus of the transaction 
is reached after the client receives f+1 (f is denoted as the number of byzantine 
nodes) replies from different backup nodes with the same results. PBFT algorithm 
guarantees the security and liveness, i.e., a request from a client will eventually be 
replied, when there are less than [SF] byzantine nodes, where n is denoted as the 
number of nodes which participate in the consensus process. PBFT eliminates the 
heavy computation as in PoW to elect a node to publish a new block. However, 
the benefit comes at the cost of requiring a high level of trust between the nodes to 
resist the sybil attacks [12] where a malicious party can create many nodes to bias 
the consensus toward itself. Thus, PBFT algorithm is usually used in consortium 
blockchain networks, e.g., Hyperledger Fabric. 

Solution to Discrepancy: Since a blockchain is built upon a distributed network, it 
might take some time for all nodes in such a network to update a new block. Besides, 
there are multiple nodes mining at the same time. The latency of distributing a new 
block and the probability that another block is created during the latency make it 
possible that there exists more than one chains in the network at the same time. In this 
case, discrepancy about which chain is valid between the nodes arises. Specifically, 
nodes need to decide to believe one chain by working to extend it with a new block. 
The discrepancy is solved with the longest chain rule, i.e., the longest chain will 
be accepted with the other chains being discarded. A simple rationale behind this 
solution is that the longest chain is the chain that the majority of the nodes trust and 
work on extending. Over the long time scale, the solution guarantees that only one 
chain prevails. 

Digital Signature: To verify the authentication and integrity of transactions, digital 
signatures based on asymmetric encryption are used in blockchain networks. Each 
node in a blockchain network has two keys, including a public key and a private key, 
and the content encrypted by the private key can only be decrypted by the private 
key. Before a node initiates/broadcasts a transaction, it first signs the transaction 
with its private key. Other nodes in the network can then verify the authenticity of 
the transaction using the public key. With the private key kept confidential to its 
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owner and the public key accessible by all nodes, the authenticity and the integrity of 
transactions can be easily verified. Thus, one cannot masquerade as others to initiate 
transactions or to forge the contents in the initiated transactions. 

Types of Blockchain: Based on the rule to regulate which nodes can access, verify 
and validate the transactions initiated by other nodes, blockchains are typically cate- 
gorized into public blockchains, private blockchains and consortium blockchains to 
satisfy the requirements in different applications. 


1. A Public Blockchain is designed to be accessible and verifiable by all the nodes 
in the network. Specifically, all nodes in a public blockchain network can verify 
transactions, maintain a local replica of the blockchain, and publish a new block 
into the blockchain. By granting the authority of maintaining a ledger to all the 
nodes, public blockchains are fully distributed. Such a blockchain is widely used in 
anonymous trading. However, the system suffers from the low speed of transaction 
validation, and requires certain level of computation to secure that an unbiased 
block is created. Bitcoin [1] is one of the most popular cryptocurrency supported 
by a public blockchain. 

2. A Private Blockchain is usually maintained by a single organization. The rights to 
access the blockchain and to verify the transactions are granted through a central 
controller to the permissioned nodes. A permissioned network is thus established, 
in which only the authorized nodes can access certain transactions of the blockchain 
or participate in working to publish new blocks. In this way, the privacy of the 
transactions is highly improved and the decentralization of authority of transaction 
validation is under the control of the organization. Moreover, with a high level of 
trust among the nodes in the permissioned network, the computation-intensive 
consensus algorithm is not needed. 

3. A Consortium Blockchain is similar to a private blockchain in the sense that they are 
both maintained in a permissioned network. The difference is that in consortium 
blockchain, there involve multiple organizations to share the right to access and 
validate the transactions. Although these organizations might not fully trust each 
other, they can work together by altering the consensus algorithm based on the 
level of trust among them. 


Work Flow of Blockchain: In Fig. 5.2, we show the work flow of a blockchain 
using the PoW consensus algorithm. Firstly, a transaction is initiated and broadcast 
to other nodes in the network. The nodes which receive the transaction use the 
digital signature to verify the authentication of the transaction. After verified, the 
transaction is appended to the list of valid transactions in the nodes. To record the 
verified transactions, nodes in the network work to publish the new block, i.e., find 
Nonce. Once one node finds a valid Nonce, it is allowed to publish a block which 
contains the initiated transaction. The other nodes then verify transactions in the 
block received by comparing the Merkle root, and once the transactions in the newly 
published block are proven to be authenticated and not tampered, the new block is 
added to the local replica of the blockchain. The update of the blockchain has been 
completed. 
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Fig. 5.2 The work flow of a blockchain network 


5.2.2 Features and the Potential Attacks on Blockchain 


The features of a public blockchain are summarized below. 


e Decentralization: In a public blockchain network, the transactions are recorded by 
all the nodes in the network and each node has a local copy of the ledger in which 
transactions are recorded. In this way, the distributed ledger is protected against 
the single point of failures. 

e Trustless: In a blockchain network, a trusted third party is not needed to validate 
the transactions, neither should one node need to trust others before they can 
transact. The consensus algorithm in the blockchain is used to validate and record 
the transactions in a more democratic manner than the centralized approach. 

e Immutability: Using a one-way cryptographic hash function, any modification of 
the previous blocks in a blockchain invalidates all the consequently generated 
blocks. Thus, to tamper transactions recorded in a previous block, the malicious 
node needs to create a new block and replicate all the following blocks. With other 
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nodes continuing to create new blocks, the manipulation is hard to achieve, which 
makes the blockchain immutable. 

Non-repudiation: A transaction is cryptographically signed with a private key 
before broadcast to others. The authentication of transactions can be verified by 
others via the corresponding public key which is accessible to other nodes. Since 
the private key is kept by its owner, one node cannot masquerade others to initiate 
transactions and one verified transaction cannot be denied by its initiator. 
Transparency: In a public blockchain network, every node can access the transac- 
tions stored in the blockchain and verify the initiated transactions. Data stored in 
blockchain is thus transparent to the public. 

Traceability: The block header is attached with a timestamp which records the 
time when the block is created. Nodes can thus easily verify and trace the origin 
of the historical blocks. 


Although relatively secure, the blockchain is still under the risk of multiple kinds 


of attacks, such as selfish mining attack, majority attack and Denial of Service (DOS) 
attack [13]. 


Selfish Mining is applied by the malicious nodes to withhold the blocks they have 
successfully mined or to hold and then release the blocks. In this way, the nodes can 
make other miners waste their computational resources to find the Nonce which 
has been found by the attackers. On the other hand, by withholding a mined block, 
the attacker can start earlier than others to find the Nonce of the next block. 
Majority Attack might happen when one node or a coalition of nodes possesses 
more than 50% of the computational resources of all the nodes in the network. 
With the PoW consensus algorithm, such nodes have a probability larger than 0.5 
to successfully mine and publish a new block. Thus, they can arbitrarily reverse 
or halt the transactions by publishing new blocks. The majority attack can also 
be performed by an attacker without such a high proportion of computational 
resources. Specifically, they can employ other nodes to help it privately extend a 
chain with a block published by itself. Once the private chain is longer than the 
existing one in the network, the attacker can make the new chain public. Based 
on the longest chain rule, the new chain will be accepted by other nodes in the 
network, and the transactions in the newly accepted blockchain, which might favor 
the attacker, will also be accepted. 

Denial of Service Attack happens when malicious nodes completely occupy the 
resources to verify or to transmit the blocks and transactions. Specifically, mali- 
cious nodes can initiate plenty of transactions to other nodes to disable the trans- 
mission and verification of transactions from other nodes. 


5.2.3 Smart Contracts Enabled by Blockchain 


Smart contracts, enabled by the blockchain technology, are self-executing contracts 
without extra enforcement. The contractual clauses between nodes are converted 
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into computer programs in a form such as “If-Then” statements. The executable 
computer programs are then securely stored in the blockchain. When the predefined 
conditions in smart contract are satisfied, the clauses in smart contracts will be exe- 
cuted autonomously, and the execution will be recorded as an immutable transaction 
in the blockchain. 

The generation procedures of a smart contract are shown in Fig.5.3, and the 
work flow of the smart contracts is demonstrated as follows. The involved nodes 
first negotiate to agree upon and sign contractual clauses. The approved clauses are 
further recorded in a transaction. Similar as other transactions, such a transaction 
which records the smart contract will be verified by other nodes and then appended 
to other transactions in a block. With the consensus algorithm, a block contains the 
smart contract will be added into the blockchain. The smart contract will then be 
allocated with a unique address, through which the nodes in the network can access 
or interact with it. Once some node sends transactions to that address or the conditions 
in the smart contract are satisfied, the corresponding clause in the smart contract will 
be strictly executed. 

Bitcoin is known as the first cryptocurrency that supports basic smart contract 
in the sense that the network allows one user to transfer value to another. However, 
the limited programmability makes it impossible to support a smart contract with 
complex logic. Ethereum is the first public blockchain-based platform which sup- 
ports the advanced smart contracts which are encoded by high level programming 
implementation. 


5.3 Blockchain for Spectrum Management: Basic 
Principles 


In this section, we will first provide the potential aspects from which the application 
of the blockchain technology can benefit DSM. Note that we mainly consider the 
spectrum management in a sharing use. If not specifically mentioned, all blockchains 
in this section are public blockchains. Then, we outline three different ways to deploy 
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a blockchain network over a cognitive radio network. Finally, we will bring up and 
discuss challenges in the application of blockchain to DSM. 


5.3.1 Blockchain as a Secure Database for Spectrum 
Management 


Blockchain, as essentially an open and distributed database, can be used to record any 
kind of information as a form of transaction. On the other hand, spectrum manage- 
ment can benefit from the assistance of a database, such as a geo-location database 
for the protection of incumbent users in TV white spaces [14]. Based on this, one 
potential trend of applying blockchain to spectrum management is to record the 
information about spectrum management (Fig. 5.4). 

One main reason of this application is that blockchain makes such information 
accessible to all the secondary users. Such kinds of information include the TV White 
Spaces, the spectrum auction results, the spectrum access history and the spectrum 
sensing results. Here, we discuss the benefits of recording these kinds of information 
on spectrum management. 

Information of TV White Spaces and other underutilized spectrum bands can be 
dynamically recorded in a blockchain. In a secure blockchain, the information includ- 
ing interference protection requirements of the primary users and the spectrum usage 
with respect to time, frequency and geo-location of TV white spaces can be recorded. 
Compared to a traditional third party database, blockchain allows users directly con- 
trol the data in the blockchain and thus guarantees the accuracy of data. Another 
concern of spectrum management is its dynamic characteristic. With the mobility of 
mobile secondary users or the variation of traffic demands of the primary users, the 
availability of spectrum bands might change dynamically. With the decentralization 
of blockchain, the information of idle spectrum bands can be dynamically recorded 
by primary users and easily accessed by all the unlicensed users. Moreover, by ini- 
tiating a transaction, SUs can inform others their departure or arrival to some area, 
to help others to capture the potential spectrum opportunities in the area where they 
are located, to finally optimize their transmission strategies. Thus, the efficiency of 
spectrum utilization can be improved. 

Spectrum Access History of the unlicensed spectrum bands can be recorded in 
a blockchain. With the existing access protocol such as Carrier Sensing Multiple 
Access with Collision Avoidance (CSMA/CA) and Listen-Before-Talk (LBT), the 
access is not needed to be coordinated. However, the access history needs to be 
recorded in the blockchain to achieve the fairness in all the users. For example, with 
the autonomous implementation of smart contracts, the users which are recorded to 
access the unlicensed spectrum bands up to a frequency threshold will be not allowed 
to access the same spectrum bands in a fixed period. 
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Spectrum Auction Results can also be recorded in a blockchain. Auction mech- 
anisms have been shown as an efficient way for dynamic spectrum allocation [15]. 
Among the spectrum auctions, the secondary auctions are used when the licensed 
primary user (PU) shares the spectrum with secondary users (SUs). The sealed- 
bid spectrum auctions, where the SUs as bidders send their bids to the PU who 
is auctioneer privately, can improve the efficiency of spectrum auction. Moreover, 
the second-price sealed-bid auction, can guarantee the truthfulness of spectrum auc- 
tions, which means that SUs will obtain optimal utilities by submitting the bid with 
respect to their true valuation of the spectrum bands, instead of deceiving the auc- 
tioneer. Although sealing the spectrum auction results can be beneficial from the 
above aspects, recording the auction results such as the bids and the hammer price, 
at which the SUs and the PU make a deal, after the auction is completed, is also 
important. Blockchain provides an secure and verifiable way to record such infor- 
mation. Specifically, recording of spectrum auction results in a blockchain can be 
beneficial from the following aspects. 


1. Prevent the frauds from a PU. The lack of transparency of bids and the hammer 
price can lead to the occurrence of frauds. For example, it is possible that one 
dishonest PU charges the winning SU with a forged price or grants more than 
one SUs the exclusive access right of spectrum bands, to increase its revenues. 
However, this kind of frauds cannot be detected by the SUs since the bids are 
sealed. With the use of blockchain, the bids and hammer price can be immutably 
recorded as a transaction after the auction is ended and the information can be 
verified and accessible by all the SUs. It is thus easy to detect and prevent the 
frauds of a PU. 

2. Guarantee the non-repudiation of auction payment. Since that the transaction 
which records the bids and hammer prices is verified by all SUs before being 
recorded in a blockchain, the wining SU cannot repudiate the bid they submit. 
Thus, the PU as the spectrum resource provider, can be secured to obtain its right- 
ful payment after the auction is completed. 

3. Prevent the unauthorized access of SUs. Recorded in a blockchain, the results of 
spectrum auctions are accessible to all the SUs. To ensure the fairness of spectrum 
auctions, all SUs can collaboratively supervise and prevent the unauthorized access. 
In this way, no SU can access the spectrum without participating in and wining the 
spectrum auctions. 


Spectrum Sensing Results are another kind of information which can be stored in 
a blockchain. The sensing results stored in the blockchain can be used to map the 
spectrum usage of the primary networks and hence provide them an additional tool 
for monitoring and maintaining of their networks. Moreover, this could potentially 
encourage more licensed users to allow shared use of spectrum. Without the help of 
secondary users to submit the sensing reports, however, a cellular network operator 
can achieve the above objective by deploying a sensor network to monitor and record 
the spectrum usage in a blockchain. On the other hand, the sensing results recorded 
in the blockchain can be used as prior information when SUs need to choose which 
licensed spectrum bands to sense and access. In particular, SUs can estimate the 
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utilization rate of different spectrum bands from the historical sensing results, and 
SUs can thus choose the spectrum bands with a relatively low utilization rate. 


5.3.2 Self-organized Spectrum Market Supported by 
Blockchain 


With the tamper-proof record of transactions, the autonomous contract execution and 
payment settlement enabled by smart contracts, blockchain is a powerful platform to 
construct a self-organized spectrum market, to provide the following applications. 

Services Implementation: A smart contract, which is a self-executing contract 
built upon a blockchain, can be used in spectrum management, with the clauses in 
the smart contract being autonomously executed and immutably recorded. Moreover, 
the payment process can also be autonomously completed by smart contracts. Thus, 
with the usage of smart contracts, services such as spectrum sensing service [9], the 
trading of transmission capabilities can be explored to be securely executed between 
the users in the blockchain network. 

Identity Management: Besides executing the services with smart contracts, 
blockchain can also provide an identity management mechanism in the spectrum 
market. Specifically, a consortium blockchain as an intermediary first collects and 
records the information from the service seekers, such as SUs, to complete the regis- 
tration process. The blockchain can then be used to authenticate the registered users 
and to only allow the registered users to access the data recorded in it. To protect 
the privacy of the users, the blockchain only provides the pseudonymous identity of 
the users when the service providers seek for the user identity authentication. Such 
a configuration is first proposed in [16], where an Identity and Credibility Service 
(ICS) is built upon a consortium blockchain. 


5.3.3 Deployment of Blockchain over Cognitive Radio 
Networks 


Blockchain, as a distributed ledger, is maintained by all the nodes in the network. 
However, it can be energy-consuming for a node to maintain the blockchain. For 
example, in the blockchain using the PoW consensus algorithm, the nodes need to 
devote computational resources to publish a new block. Thus, the deployment of 
blockchain network with the communication network should be studied. Here, we 
outline three ways to deploy the blockchain network to the cognitive radio network 
and analyze the pros and cons of these ways. 

The first way is to directly deploy a blockchain network over a communication 
network, as shown in Fig. 5.5. Specifically, since the information regarding the spec- 
trum management, which needs to be recorded in the blockchain, is produced or 
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Fig. 5.4 Blockchain as a secure database for spectrum management. The information such as 
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Fig. 5.5 Deploy the blockchain network directly on a cognitive radio network 


obtained by the nodes in the communication network, i.e., SUs and PUs, it is intu- 
itive for the nodes in the cognitive radio network to also act as nodes in the blockchain 
network. To deploy the blockchain in this way, the SUs and PUs should be equipped 
with the mining and other functions in the blockchain. Thus, all the functions of the 
blockchain, such as the distributed verification of transactions, can be performed by 
all the users. However, such kind of deployment requires a control channel through 
which the users can transmit the transactions and blocks. If a wireless control chan- 
nel is used, there exists the risk that the control channel is jammed by the malicious 
users. Once the control channel is paralyzed, the blockchain network cannot func- 
tion. 
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Fig. 5.6 The coexistence of a dedicated blockchain network and a cognitive radio network 


Another way is to use a dedicated blockchain network to help record the relevant 
information. For users in the cognitive radio network, the limited computational 
capabilities make it difficult for them to access the spectrum bands and maintain 
the blockchain at the same time. Specifically, mining, which might consume a lot of 
energy, is impractical for SUs with constrained battery to implement. To overcome 
this challenge, one possible way is to allow users to offload the task of recording 
transactions to a dedicated blockchain network, as shown in Fig. 5.6. In this way, the 
blockchain functions as an independent database. However, the transaction cannot 
be verified directly by users and the overhead of transmitting the transactions to the 
dedicated blockchain network also increases. Moreover, the nodes lose the control 
over information recorded in the blockchain. To this end, a more practical way for the 
users is to only offload the mining task, which is energy-consuming, to a cloud/edge 
computing service provider, and to record the transaction into the blockchain by 
themselves. Researchers have designed auction mechanisms to allocate computing 
resources in this case [17]. However, the offloading of mining task might lead to a 
malicious competitions between the users, which also needs to be considered when 
a blockchain network is deployed in this way. 

Besides the cognitive radio network and the blockchain network, there sometimes 
exists a third network, e.g., a sensor network, where sensors can be deployed to 
perform cooperative spectrum sensing to obtain the diversity gain. Under the same 
principle of dedicated blockchain, the above three networks can coexist and interact 
with others. Traditionally, the third network such as the sensor network directly 
communicates with the cognitive radio network. Blockchain network, however, can 
become an intermediate of the two networks. 
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5.3.4 Challenges of Applying Blockchain to Spectrum 
Management 


The application to blockchain in spectrum management is promising. However, there 
remain a few challenges with respect to, for example, transaction cost, the latency 
and the privacy leakage. Generally, the challenges can be solved by trading off 
different characteristics of a blockchain, which is shown in Fig.5.7. As it can be 
seen, the decentralization of blockchain is helpful to guarantee the non-repudiation, 
transparency and immutability, while decreasing the privacy and the scalability, and 
increasing the latency and transaction cost in the blockchain network. We introduce 
the challenges and discuss their potential solutions as follows. 

Transaction Cost: The transaction cost for a node in a blockchain network includes 
the cost to publish a new block and the communication overhead to transmit the 
transactions initiated by all the nodes. The consensus algorithm, through which a new 
block is published, such as PoW, is too computationally intensive to be sustainable 
for cognitive devices with limited computational resources and battery. Although 
users can upload the mining task to a cloud/edge computing provider to save their 
energy, it still costs them to pay for the computing service. Another solution is to 
adopt or design a more suitable consensus algorithm to lower the cost of maintaining 
the blockchain. However, an energy-efficient consensus algorithm usually required 
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Fig. 5.7 The tradeoffs in different characteristics in a blockchain network 
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a higher level of trust between nodes in the network to guarantee the security, which 
limits the flexibility of the blockchain network. 

Another cost in maintaining a blockchain is caused by the transmission of trans- 
actions. A transaction, initiated by one node in a blockchain network, needs to be 
broadcast and verified by other nodes before it can be recorded in a new block. After 
that, the new block is also needed to be broadcast to other nodes for verification and 
storage. In the case when the generation of transactions is frequent, the overhead of 
transaction transmission cannot be neglected. On the other hand, the transmission 
of transactions usually requires a control channel, which is under the risk of being 
jammed by the malicious nodes. The risk also increases the cost of transaction trans- 
mission. To conclude, tradeoff of the cost and the benefits should be considered when 
applying the blockchain to spectrum management. 

Latency and Synchronization: The latency in a blockchain network is caused 
by two phases including the mining process, and updating local blockchain of all 
the users. Firstly, the mining process, e.g., PoW consensus algorithm, is energy- 
consuming and time-consuming to guarantee unbiased selection of nodes to publish 
a new block. Moreover, after a block is published, it still requires some time for the 
successful miner to broadcast the new block and all other nodes to verify and add the 
new block to their local replicas of the blockchain. The high latency in the blockchain 
network might make it unsuitable to the applications with stringent latency require- 
ments. For example, the latency of writing the results of an spectrum auction in the 
blockchain can delay the execution of spectrum access. This will impair the rev- 
enues for the secondary users and increase the latency for transmission. On the other 
hand, the latency can also lead the fork of a blockchain, i.e., the existence of multiple 
blockchains in a network. In the fork of a blockchain, multiple auction results such as 
the recorded winner and its allocated spectrum bands might be different from that of 
the original blockchain. This will lead to the discrepancy in the spectrum access allo- 
cation among the users and even result in interferences between the users when they 
simultaneously access the same spectrum bands. Although this discrepancy could 
eventually be solved by the longest chain rule, the effect on secondary users can not 
be reversible. To conclude, the delayed spectrum access caused by the latency of the 
blockchain impairs its revenue and further discourages the users from participating 
in the spectrum auctions. 

Privacy Leakage: A blockchain guarantees its security by distributing the authority 
of maintaining the database to all the nodes in the network. As a result, any node 
can access and verify the data stored in the blockchain. In DSM, the data can be 
some private information collected by users, which might leak their location or other 
features. However, the easy and open access to the public blockchain might prevent 
users from recording any private information in it. Although a private blockchain, 
in which the access to blockchain is distributed only to permissioned nodes, can be 
employed to improve the privacy of data recorded in blockchain, this will reduce the 
decentralization of blockchain and increase the administration cost to supervise the 
nodes in the blockchain network. 

Scalability: A newly published block needs to be broadcast to all the other nodes 
and stored in the local replica of all nodes. Thus, the number of transactions in a block 
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is limited since containing too many transactions might make it be orphaned, which 
occurs when it can not be included to the local blockchain replica of all the nodes 
on time. On the other hand, in public blockchains, there is usually a pre-defined 
block interval, which can be adjusted by setting the difficulty of block creation. 
Reducing the block interval can increase the transaction throughput. However, it 
also increases the risk of creating blockchain forks and thus reduces the security. 
Thus, the scalability of blockchain, defined as the transaction throughput per second, 
is limited. To solve this, a more efficient consensus algorithm can be adopted to 
decrease the block interval, or a private/consortium blockchain can be used instead 
of a public blockchain, to decrease the number of nodes which need to store a local 
blockchain copy, and to increase the speed of propagation of a new block to all the 
nodes. 

Attacks on Blockchain: The major kinds of attacks on a blockchain are introduced 
in Sect.5.2. These attacks can degrade the security or increase the latency of the 
blockchain, to further affect the dynamic spectrum management which uses the 
blockchain. Take the selfish mining attacks as an example. In an application which 
uses a blockchain to record the spectrum auction results, the selfish mining attacks 
will delay the time for a transaction, i.e., spectrum auction results, to be successfully 
recorded in the blockchain. Thus, the allocation of spectrum bands cannot be executed 
on time. The denial of services (DoS) attacks can also be implemented by jamming 
the control channel, through which the transactions are transmitted. 


5.4 Blockchain for Spectrum Management: Examples 


In this section, we give some examples to show how the blockchain technologies 
can be applied to DSM. Firstly, using the consensus algorithm, researchers have 
enhanced the performance of traditional spectrum access or developed new spectrum 
access protocol. Besides, the spectrum auctions secured by a blockchain will also 
be introduced. Moreover, we introduce a novel cooperative-sensing-based spectrum 
access protocol, which is also enabled by the blockchain technologies. 


5.4.1 Consensus-Based Dynamic Spectrum Access 


A consensus algorithm adopted in the competition of mining in blockchain, such 
as the PoW algorithm, is used to select one node to create a new block in an unbi- 
ased and distributive manner. They can be also used to manage the spectrum access 
where the coordination of the access requests from SUs is needed to avoid colli- 
sion. Furthermore, with the use of Distributed Ledger Technology (DLT), the queue 
derived using a consensus algorithm can be distributively recorded. Overall, using 
the consensus algorithm, we can either enhance the performance of traditional access 
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protocols or propose new access protocols. Here, we introduce two instances of the 
consensus-based dynamic spectrum access (DSA). 

It is noted that in traditional spectrum auctions, the computational complexity to 
derive the optimal bid might be high for cognitive devices limited computational 
capabilities, and the time to derive the optimal bid might occupy the time for trans- 
mission. In [18], authors proposed a puzzle-based auction to improve the efficiency 
of spectrum auctions. The essence of the puzzle-based auction mechanism is to make 
SUs win the spectrum auction by competing to solve a complex math problem, rather 
than through traditional bidding. Specifically, in a puzzle-based auction, an auction- 
eer advertises an access opportunity, and SUs who are interested then respond to 
the auctioneer to obtain a math problem and will be charged with an entry fee. The 
involved SUs then start working on solving the math problem. The first SU who sub- 
mits the correct answer of the problem to the auctioneer will be granted to access the 
advertised spectrum band. To guarantee the fairness of the auction, the math problem 
is set to be non-parallelizable, e.g., to find the n-th digit of 2, meaning that the prob- 
lem cannot be computed in a parallel manner. By doing so, the SUs cannot devote 
more parallel computational resources to obtain a greater chance to win the auction, 
which ensures the fairness and prevents the malicious competition of the spectrum 
auction. Since the competition of winning one puzzle-based auction is similar to the 
mining process, the auction can be seen as a centralized consensus algorithm, where 
the verification of the winner of the auction is performed only by the PU. 

In [19], with the use of the DLT, the authors proposed a distributed DSA protocol, 
so called consensus-before-talk in which the access requests of the SUs are stored as 
transactions and queued with a consensus which is distributively achieved between 
all the nodes by a pre-defined rule. The system is shown in Fig.5.8. In such a sys- 
tem, the collision of SUs is avoided by distributively queuing the access requests 
from different users and the latency of transmission for SUs can thus be reduced. 
Specifically, an SU first generates an access request as a form of transaction and 
uses the gossip-of-gossip protocol to spread the transaction. The SU who receives 
the transaction then verifies the authentication of the request through digital signa- 
ture and adds its verification time to the transaction, and finally sends the modified 
transaction to another SU. After all the SUs have verified the transaction, the SUs 
spread the transaction again. Lastly, each SU has a copy of the transaction with the 
verification/generation time from all SUs and each SU can calculate the consensus 
time using the verification and generation time of the transaction. After that, the 
transactions are added to their local ledger in a order decided by the calculated con- 
sensus time. Through these procedures, a consensus, which regulates the queue of 
spectrum access, is distributively reached among all the SUs. 


5.4.2 Secure Spectrum Auctions with Blockchain 


Auction mechanisms have been proven to be an efficient way for dynamic spectrum 
management. However, the security of the spectrum auctions is mainly guaranteed 
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Fig. 5.8 A consensus-based dynamic spectrum access framework 


by third-party entities [15]. On the other hand, there usually lacks validation of the 
transactions in a traditional spectrum auction. Although some centralized valida- 
tion mechanisms, which are executed by a centralized authority, are proposed, such 
mechanisms are vulnerable to single point of failures [7]. A distributed validation 
mechanism, which is accessible to and verifiable by all the users in the network, is 
thus desired. Blockchain, as a distributed ledger, can be used to overcome the security 
challenges in the spectrum auctions. 

In [7], authors proposed a blockchain-enabled DSA scheme based on the puzzle- 
based auction. In such a DSA system, SUs are seen as both sensing nodes in the 
cognitive radio network and mining nodes in the blockchain network. A PU leases 
its idle spectrum to the SUs through a blockchain without an auctioneer. Leveraging 
on the blockchain, the spectrum transactions are recorded and verified in immutable 
and distributed manner by the SUs. The procedures of the spectrum auction system 
in [7] are introduced below. Firstly, the advertisement of spectrum opportunity is 
broadcast by an PU through a control channel, and a puzzle-based auction is used 
to determine the winner of the auction. If the the winner has sufficient tokens to 
sustain the pre-defined spectrum payment, then the access is granted. Otherwise, 
the auction is restarted, and the malicious bidder, i.e., the SU who takes part in the 
auction but has an insufficient budget, will be deprived of the bidding right. After 
the auction is completed, a new transaction recording the auction result needs to be 
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Fig. 5.9 Procedures in a blockchain-secured spectrum auction 


recorded in the blockchain. SUs then work to create a new block via mining. The 
SU which successfully publishes a block will be rewarded with the tokens, named 
as specoins, in the network. With the PoW consensus mechanism, the difficulty 
of creating a new block increases as the blockchain grows longer. To prevent the 
creation of a new block from being impossible for SUs which are equipped with 
limited computational capabilities, the blockchain will be reset at a fixed frequency. 
The reset can be achieved by creating the first block of a new blockchain, in which 
the balances of SUs and the PU are recorded. 

Although [7] uses the puzzle-based auction to reduce the complexity and thus 
to improve the efficiency of spectrum auctions, it is straightforward to extend this 
system to adapt to other auction mechanisms since a blockchain is only used to 
verify and record the result of a spectrum auction. A more general blockchain- 
secured spectrum auction system is depicted in Fig. 5.9, where we omit the detailed 
procedures of spectrum auction. 

Enabled by the blockchain technologies, the security of spectrum auctions using 
a blockchain has been improved with the following features. 


e Decentralization: The spectrum transactions are verified and recorded in a dis- 
tributed and immutable manner. Compared to the centralized auction system, 
where the transaction is verified and stored by a trusted third-party, the blockchain- 
enabled auction system is robust against the single point of failures. 

e Accessibility: With a mechanism to help exchange the real currency with the cryp- 
tocurrency, and using the public blockchain which is accessible to any node in the 
public, any interested SU can participate in the spectrum auction. Moreover, the 
registration procedures of users and the reliance on the trust between the user and 
the auctioneer are eliminated. In this way, the spectrum resource is more accessible 
by all the users. 
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e Verification of User Identity: With the use of the digital signature in each trans- 
action, the authentication of SUs and PUs can be verified by all the users. Thus, 
malicious user cannot impersonate another SU to submit bid in the spectrum auc- 
tions or impersonate the PU to initiate an auction. The account of users can thus 
be secured. 

e Fraud Prevention: The transparency of transactions prevents the frauds of a PU, 
e.g., overcharging the winning SU with a forged price. 


5.4.3 Secure Spectrum Sensing Service with Smart Contracts 


In [9], the authors use smart contracts to autonomously execute the spectrum sensing 
service. It is known that without the cooperation of PUs, the access opportunity can 
only be obtained by spectrum sensing. However, due to the adverse channel fading 
effect, the sensing result of a single SU might be incorrect. Cooperative sensing by 
multiple SUs can be used to improve the sensing performance. However, when an 
SU does not need to access the spectrum, there lacks incentive for it to participate 
in the cooperative sensing, which is energy-consuming. To this end, in [9], authors 
proposed to improve the sensing performance by deploying multiple sensing nodes, 
so called helpers to provide the SUs with the sensing service and to use the smart 
contract to implement the spectrum sensing service. In this way, an SU can offload 
its sensing task to the sensing helpers, and the sensing helpers can obtain revenues 
by charging the SUs. Specifically, the SU firstly broadcasts the smart contract, in 
which a sensing quality requirement is recorded, to the sensing helpers. Then, the 
sensing helper checks if it satisfies the requirement and then decides whether to 
provide the sensing service. After that, smart contract selects the helpers and collects 
the sensing reports from them. Moreover, the algorithms to detect and remove the 
malicious sensing helpers, which reports a false or random sensing report, can be also 
executed autonomously by smart contract. The last procedure in the smart contract 
is to autonomously pay the service provider. From the above execution process, it is 
noted that with the use of smart contract, the sensing service can be implemented and 
supervised in an autonomous and immutable way, and with the use of a permissionless 
blockchain, an elaborate registration of sensing helpers is eliminated. 


5.4.4 Blockchain-Enabled Cooperative Dynamic Spectrum 
Access 


Cooperative sensing is used to improve the accuracy of spectrum sensing, which 
gives the SUs a better chance for opportunistic access. To achieve cooperative sens- 
ing, a centralized approach is to deploy a fusion centre to collect and fuse the sensing 
reports from SUs. Moreover, the fusion centre can analyze the collected sensing 
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Fig. 5.10 The sequence of operations in a time slot 


reports to detect the malicious SUs which report false or random reports for maxi- 
mizing its own benefits. Although easy to be implemented, this centralized scheme 
is vulnerable to single point of failures. In particular, the cooperative sensing scheme 
will break down when the fusion centre is hacked. In this case, the whole secondary 
network is no longer secure. Moreover, there exits a potential type of attacks in which 
an attacker emulates an SU to report false sensing results to the fusion centre. Thus, 
the authentication of SUs should verified [20]. A decentralized and secure cooper- 
ative sensing scheme to address the above concerns is thus desired. Furthermore, 
cooperative sensing also needs an incentive mechanism to encourage the SUs to 
spend the additional energy for cooperative sensing. 

Here, we propose a decentralized cooperative sensing scheme, where the sensing 
reports of SUs are spread collaboratively by all the SUs, and once an SU collects all 
the sensing reports, it derives the final result by its local fusion rule. Moreover, the 
sensing results are securely recorded as a transaction in the blockchain. To achieve 
this, one SU acts as both a sensing node and a mining node. However, the energy 
consumed by sensing and mining might prevent SUs from collaboration. To this 
end, we propose an effective incentive mechanism which guarantees that the efforts 
of SUs paid to cooperatively sensing and mining are proportional to their chances 
to access one cooperatively sensed the idle spectrum band. Specifically, the SUs 
which participate in cooperative sensing and win the mining will be rewarded with 
tokens in a virtual currency and the SUs can bid for the access opportunity using 
the tokens they earn. Note that the virtual currency will be supported and secured by 
the blockchain. In this sense, by fairly allocating the cooperatively obtained access 
opportunity, SUs are effectively incentivized to participate in cooperative spectrum 
sensing and mining, and a DSA framework is thus established. 

The proposed DSA framework includes a protocol that specifies a time-slotted 
five-phase operation by the SUs to obtain an access to the spectrum, as shown in 
Fig.5.10. Specifically, the SUs first choose whether to sense the primary channel 
according to its sensing policy (Phase I). Then, SUs exchange their sensing results 
through a control channel (Phase IT). If the fused sensing result shows that the 
spectrum is idle, SUs decide the bid for the access according its bidding policy 
and exchange their bids (Phase III). Then, SUs decide whether to work on mining 
according to its mining policy, and the successful miner will create and broadcast a 
new block that records the sensing results, bids of SUs and the wining bidder (Phase 
IV). Finally, the winning SU accesses the spectrum to transmit its packets (Phase V). 
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The benefits of the proposed cooperative-spectrum-sensing-based DSA frame- 


work are as follows: 


By allocating the spectrum band through auctions, it prevents the collision of SUs 
which sense and access the same spectrum band. 

With the help of hashing and digital signature in the blockchain technology to dis- 
tributively verify the authentication of SUs, the proposed DSA framework thwarts 
the SU emulation attack in the cooperative sensing. 

The decentralized cooperative sensing scheme in the DSA framework is free from 
single point of failures by eliminating the need of a fusion centre. 

The virtual currency, secured by the blockchain, provides an effective mechanism 
to incentivize SUs to cooperative sensing and mining. 

The use of blockchain helps to securely record the historical sensing, bidding, and 
access results. 

The recorded historical sensing results in the blockchain can be used by SUs to 
predict the spectrum usage or to detect the dishonest/malicious SUs which send 
random/false reports. Moreover, they can be used for PUs to monitor and maintain 
the usage of its licensed spectrum bands. 


According to the DSA framework, three policies are important for the SUs to 


finally obtain the spectrum access opportunity. For each SU, to maximize its token 
revenues, it needs to sense and mine in all the time slots. However, it might be a 
waste of energy for all SUs to always sense and mine. In this sense, we propose a set 
of heuristic policies for SUs to distributively make the sensing, bidding and mining 
decisions. 


1. 


2: 


Sensing Policy a; (t): By a sensing policy, denoted as a; (t), SU i determines whether 
it should sense the primary channel, with a;(t) = 1 and a;(t) = O representing 
sensing and not sensing, respectively. We consider a probabilistic sensing policy 
by which each SU decides whether to sense in t-th time slot with a fixed probability 
P,, i.e., 

1, with probability P,, 


0, with probability 1 — P,. 6D 


ai (t) =| 


Bidding Policy b;(t): By a bidding policy, denoted as b;(t), SU i determines how 
many tokens that it should use to bid for the spectrum access. Denote n;(t) as 
the balance of SU i’s wallet. Then the bid that an SU can place is limited by the 
maximum number of tokens that it has, i.e., b; (t) < n;(t). We consider a bidding 
policy that is based on its current buffer occupancy ratio and its currently available 
token values. Mathematically, the bid of SU 7 in f-th time slot is determined to be 


bit) = nj(t), (5.2) 


qi (t) 
Qi 
where q; (t), Q; denote the number of packets in the buffer and the buffer size of 


SU i, respectively. Under this bidding policy, an SU dynamically adapts its bid 
to its current buffer state, which represents its urgency to access. Thus, when its 
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buffer occupancy ratio is high, it is allowed to submit a high bid to obtain a better 
chance to access. 

3. Mining Policy c;(t): By a mining policy, denoted as c; (t), SU i determines whether 
it should work on mining to update the blockchain, with c;(t) = 1 and c;(t) = 
0 representing mining and not mining, respectively. Similarly with the sensing 
policy, we consider a probabilistic mining policy according to which each SU 
randomly decides whether to participates in mining in the f-th time slot with a 
fixed probability Pn, i.e., 


1, with probability Pp, 


0, with probability 1 — Pn. (aa 


an = | 


5.5 Future Directions 


The application of the blockchain technologies to dynamic spectrum access is still at 
its infancy. As mentioned in the preceding sections, there still exist many challenges 
to be addressed. In this section, we will give some future directions of work so 
the benefits of the blockchain technology can be better harvested to support more 
efficient dynamic spectrum access in the future. 


e Incentive Mechanisms Using Blockchain: Blockchain has successfully supported 
many kinds of cryptocurrency. With cryptocurrency, it is convenient to design 
incentive mechanism for users to contribute to the spectrum management. For 
example, tokens in the cryptocurreny can be rewarded to the users which partici- 
pates in the spectrum sensing, to help explore the access opportunity or monitor 
the spectrum utilization efficiency of licensed bands. The tokens can also be used 
to obtain the access opportunity or to get other services provided by other users. 

e Design of Consensus Algorithms: Besides the properties including correctness, 
consistency, termination and total order [21], which a consensus algorithm needs 
to satisfy, the latency and computational cost of the consensus algorithm should 
also be considered when applying blockchain to dynamic spectrum management. 
Generally, a computationally efficient consensus algorithm is needed to reduce the 
computation consumption of users with the limited battery. On the other hand, the 
PoW consensus algorithm, with which the nodes reach the consensus by devoting 
computational resources to solve a puzzle, costs the nodes in the network to perform 
useless computation, i.e., finding a random number by trial and error. To this end, 
proof of useful work [22] can be employed to let the users solve a practical puzzle 
to increase the usefulness of computation to reach the consensus. 

e Flexibility of Blockchain Networks: With the communication overhead of transac- 
tion transmission determined by the distance of the users, it is needed for the users 
in the blockchain network to stay in a relative small area. On the other hand, same 
spectrum bands can be allocated to users in different areas since the interference 
of them reduces with the increase of their distance. To control the transaction cost 
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and improve the utilization of spectrum resources, it is thus practical to design dif- 
ferent blockchain networks to manage the spectrum resources in different areas. 
However, it is not suitable to use private blockchain network which needs to verify 
the identity of nodes in the network and assign the permission to the trusted nodes. 
This is because the mobile users can frequently change its locations and need to 
be permissioned once they get into a new private blockchain network. Thus, how 
to adopt or design an efficient blockchain to guarantee the flexibility should be 
considered in the future researches. 

e Allocation of Energy and Maximization of Revenue: With the consensus algorithm 
such as PoW, the creation of block can be computationally intensive. It is thus 
crucial for users to allocate their limited computational resources/energy between 
mining and data transmission. The former helps the users to obtain the revenue 
from token rewards and transaction fees, while the latter helps to obtain the revenue 
by providing the transmission service. With limited energy, there exits a tradeoff 
between the revenue from the blockchain and the revenue from data transmission 
service provisioning. Specifically, if one node spends more energy on mining, it is 
more probable for them to mine a new block and obtain the token reward. However, 
the power for transmission is reduced which degrades the performance of trans- 
mission. Although the mining task can be offloaded to an edge computing service 
provider, the balance should be considered between the cost on the computing 
service and the revenue from the transmission service. An interesting trade-off 
on the achievable throughput arises when the tokens rewarded by mining can be 
used for purchasing the spectrum access license. That is, if a user spends more 
energy in mining, although its probability to obtain the spectrum access opportu- 
nity increases, the transmission performance such as achievable throughput will 
be degraded as the energy left for transmission will be less. 

e Frequency of Blockchain-based Spectrum Auctions: One application of blockchain 
to dynamic spectrum management is in the spectrum auction, which is designed to 
dynamically allocate the spectrum resources to improve the spectrum utilization 
efficiency. Besides the merits such as security, transparency and accessibility, using 
the blockchain to hold and record the spectrum auction can reduce the administra- 
tion cost on it. However, the cost of blockchain to validate the transactions cannot 
be ignored. Although increasing the frequency of spectrum auctions can achieve 
better utilization of the spectrum resources, the cost of recording the increasing 
number of transactions also increases. Under some circumstances, the increase of 
frequency to hold the spectrum auctions can even affect the execution of spectrum 
auction results. Specifically, if the frequency of spectrum auctions is so high that 
there is not enough time for all the users to validate and record the transactions, 
the results of auctions cannot be executed on time. To conclude, the frequency 
of blockchain-based spectrum auction should be optimized to tradeoff between 
the spectrum utilization efficiency and the cost of recording transactions in the 
blockchain. 
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5.6 Summary 


In this chapter, we have investigated the applications of blockchain to dynamic spec- 
trum management. We have first briefly introduced blockchain technologies. We 
have then given the basic principles which illustrate how and why it is helpful to 
apply blockchain technologies to dynamic spectrum management, with challenges 
summarized at last. Moreover, we have introduced some instances of blockchain for 
dynamic spectrum management. Finally, we have discussed the future directions. 
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Chapter 6 A) 
Artificial Intelligence for Dynamic geai 
Spectrum Management 


Abstract In the past decade, a significant advancement has been made in artifi- 
cial intelligence (AI) research from both theoretical and application perspectives. 
Researchers have also applied AI techniques, particularly machine learning (ML) 
algorithms, to DSM, the results of which have shown superior performance as com- 
pared to traditional ones. In this chapter, we first provide a brief review on ML 
techniques. Then we introduce recent applications of ML algorithms to enablers of 
DSM, which include spectrum sensing, signal classification and dynamic spectrum 
access. 


6.1 Introduction 


Artificial intelligence (AI), also known as machine intelligence, has been seen as 
the key power to drive the development of future information industry [1]. The term 
AI was coined by John McCarthy in a workshop at Dartmouth College in 1956, 
and he defined AI as “the science and engineering of making machines, especially 
intelligent computers” [2]. Generally, AI is defined as the study of the intelligent 
agent, which is able to judge and execute actions by observing the surrounding 
environment so as to complete certain tasks. The intelligent agent can be a system or a 
computer program. With the significant advancement in the computational capability 
of computer hardware, various theories, especially machine learning techniques, and 
applications of AI have been developed in the past two decades. 

With the surging demand for wireless services and the increasing connections of 
wireless devices, the network environments are becoming more and more complex 
and dynamic, which imposes stringent requirements on DSM. In the age of 5G, AI 
has been seen as an effective tool to support DSM in order to tackle the transmission 
challenges, such as high rate, massive connections and low latency [3, 4]. By adopting 
ML techniques, the traditional model-based DSM schemes would be transformed to 
the data-driven DSM schemes, in which the controller in the network can adjust 
itself adaptively and intelligently to improve the efficiency and robustness of DSM. 
AI-based DSM schemes have thus attracted more and more attention in recent years, 
and have shown great potentials in practical scenarios. 
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The applications of AI techniques would bring significant benefits to DSM. Firstly, 
the AI-based DSM schemes normally do not need environmental information as 
the prior knowledge, and they can extract useful features from the surroundings 
automatically. Secondly, AI-based DSM schemes can be re-trained periodically and 
thus they are more robust to the changing environment. Additionally, by applying AI 
techniques, DSM can be done in a decentralized and distributed manner, leading to a 
significant reduction of signal overheads, especially for large-scale systems. Finally, 
once trained, Al-based DSM schemes are low in complexity for processing newly 
arrived data and thus they are more suitable for practical implementation. 

While it is believed that machine learning techniques are effective methods for 
developing and optimizing the next generation networks [5], there also exist some 
challenges in applying AI techniques in DSM. For example, different from images, 
the received signal and its higher order statistics in wireless networks are normally 
complex numbers, which are hard to process directly by neural networks. Addi- 
tionally, in a typical wireless communication system, accurate network data such as 
channel information, is hard to obtain in practice. Hence, there are many remaining 
challenges and problems to be addressed for achieving wireless intelligence. In this 
chapter, we first provide a brief review of machine learning techniques, then intro- 
duce some applications of these algorithms to DSM, including spectrum sensing, 
signal classification and dynamic spectrum access. 


6.2 Overview of Machine Learning Techniques 


As the core technique of AI, machine learning (ML) is a multidisciplinary subject 
involving multiple disciplines such as probability theory, statistics, information the- 
ory, computational theory, optimization theory, and computer science. T. Mitchell 
provided a brief definition of machine learning in 1997 as follows: “machine learning 
is the study of computer algorithms that improve automatically through experience” 
[6]. Hence, the main objective of ML is to make agents simulate or implement human 
learning behaviors. For example, with the help of ML algorithms, a machine agent is 
able to learn from training data to achieve different tasks such as image recognition. 

Based on the type of training data used, ML can be divided into two branches, 
namely, supervised learning and unsupervised learning. The former requires labeled 
training data, while the latter only uses unlabeled training data. 

In supervised learning, the objective for an agent is to learn a parameterized 
function from the given labeled training dataset and then based on the function learnt 
to predict the result directly while new data arrives. The common tasks in supervised 
learning are regression and classification. Specifically, regression is to determine the 
quantitative relationship between certain variables based on a set of training data, 
and classification is to find a function to determine the category to which the input 
data belongs. 

In unsupervised learning, since the training data is unlabeled, the agent needs 
to adopt clustering methods to obtain the relationship. A clustering method aims to 
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divide the training data into several classes based on the similarity of the data. The 
objective of clustering is to minimize intra-class distance while maximizing inter- 
class distance. Compared to supervised learning, unsupervised learning is more like 
self-study. 

Labeled data can also be generated through online learning such as reinforcement 
learning (RL). In particular, RL produces labeled experiences to train itself from 
continuous interactions with the environment, it is developed to solve a Markov 
decision process (MDP) M = {S, A, P, R}, where S is the state space, A is the 
action space, P is the transition probability space and & is the reward function [7]. 

ML techniques can also be grouped into two categories, namely, statistical 
machine learning (SML) and deep learning (DL). Using statistics and optimization 
theory, SML constructs proper probabilistic and statistical models with training data. 
DL, on the other hand, makes use of artificial neural network (ANN), also known as 
deep neural network (DNN), to perform supervised learning tasks. In recent years, 
neural network techniques have also been applied to RL, leading to the birth of deep 
reinforcement learning (DRL). In the following, we will provide a brief introduction 
to SML, DL and DRL. 


6.2.1 Statistical Machine Learning 


The objective of SML is to construct a probabilistic and statistical model using 
the training data, then, based on the constructed model, to make inferences with 
new data [8]. SML can be applied in both supervised learning and unsupervised 
learning. The commonly used supervised learning methods with SML are support 
vector machine (SVM) and K-nearest neighbor (KNN), and the commonly used 
unsupervised learning methods with SML are K-means and Gaussian mixture model 
(GMM). 


1. K-Nearest Neighbor: K-Nearest Neighbor (KNN) algorithm is a basic supervised 

learning algorithm for classification. Let T = {(X1, y1), &2, y2),.--, (XN, yn)} 
denote a given training dataset, where x; is the i-th data set and y; is the corre- 
sponding label. Assume that all data sets come from J classes. For a newly arrived 
data set x, its label, i.e., class, is determined by its K nearest labeled neighbors 
based on the adopted classification decision rules. Hence, the basic elements in 
KNN are the number of neighbors K, the distance measure and the classification 
decision rule. 
Specifically, the classification process consists of two steps: the first step is to 
search K labeled data sets which are closest to the newly arrived data set x 
according to the given distance measure. Denote the region covering these K data 
sets as Nx (x). The second step is to determine its label y by using the chosen 
classification decision rule based on Nx (x). The commonly used classification 
decision rule is the majority voting rule, which is given as 
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y= ath se > I (yi = c;) (6.1) 


PRP 


where /(-) is the indicator function that indicates if a label belongs to class c;. 
For example, I (y; = cj) = 1 if y; = cj, and I (y; = cj) = 0, otherwise. 
. Support Vector Machine: Support vector machine (SVM) algorithm is a typ- 
ical binary classification algorithm. The basic idea of the SVM algorithm is to 
find a decision hyperplane to maximize the margin between different classes. 
Specifically, for a given training data set T = {(x1, y1), (Xo, y2),..-, (Xn, yn)}, 
where y; € {—1, 1}, the objective of the SVM algorithm is to find the hyperplane 
denoted by w - x + b = 0 to make the data sets linearly separable, where w and b 
are the normal vector and the intercept of the plane, respectively. If the decision 
hyperplane is obtained, the corresponding classification decision function is given 
as 

f(x) = sign(w- x +b) (6.2) 


The hyperplane can be learnt by solving the following convex quadratic program- 
ming problem 


N 
er 
min 5 [Iw +O) (6.3) 
s.t. y; (w:x; +b) >1-—&, i=1,2,...,N (6.4) 
x, > 0,i=1,2,...,N (6.5) 


where C is a punishment parameter and &; is the soft constant for i-th data set. 
Generally, SVM is used to solve a linear classification problem, but it can also 
be used as a nonlinear classifier by introducing different kernel functions such as 
Gaussian kernel function and radial basis function. 

. K-means: K-means algorithm is a clustering algorithm, in which the unlabeled 
data sets are processed iteratively to form K clusters. Specifically, at the beginning, 
K data sets are chosen to form the initial centroids of the K clusters. Then, the K- 
means algorithm alternates the following two steps. The first step is to assign each 
of the remaining data sets to its nearest cluster. This is determined by evaluating 
the Euclidian distance between the data set and the centroid of each cluster and 
choosing the cluster with the smallest distance. The second step is to update the 
centroid of each cluster, denoted as c, based on the newly labeled data sets. 
Mathematically, this can be expressed as 


1 
Ck = — x, k=1,2,...,K (6.6) 
Ni 2 


where N; denote the set of examples assigned to cluster k. These two steps will 
repeat until a termination condition is met. 


6.2 Overview of Machine Learning Techniques 151 


Although K-means algorithm can be implemented with low complexity, its per- 
formance is influenced significantly by the initialization parameters such as the 
number of clusters and the cluster centroids. 

4. Gaussian Mixture Model: Gaussian mixture model (GMM) is a widely used 
model for unsupervised learning. The probability density function (PDF) of the 
data sets can be expressed as 


K 


p (xi) = Ym p (xi [mgs Ex ) (6.7) 
k=1 


where K is the number of Gaussian components, zz is the mixing coefficient that 


K 
satisfies ` a, = 1, and p (x; [Me Xe ) denotes the PDF of the kth Gaussian 
k=l 


component with mean mf, and covariance X4, which can be expressed as 


1 
p (xi |e Xx) = xE; exp ( (xi m) Ez! (xi — m)) (6.8) 


The unknown parameters of the GMM can be denoted as © = {7. My, Èk ae 


The objective of the GMM algorithm is to find the optimal parameters © = 
{7x My, Èk ae to maximize the following log-likelihood function 


N K 
£(0) = Yon (£a -p (Xi |My, Ex ) (6.9) 
k=1 


i=1 


Since there is no closed-form solution for the above problem, the expectation 
maximization (EM) algorithm is usually adopted to solve for the optimal param- 
eters © = frk, Hk, È ae in an iterative manner with properly chosen initial 
values for them. The EM algorithm is generally composed of two steps in each 
iteration, namely, the expectation step and the maximization step. Denote yj,x 
as a latent variable which represents the probability that example x; belongs 
to the k-th cluster. In the expectation step, the latent variable y;, is updated 


m P(X; |My, X 
as: Vik = zal |m r) , fori = 1,..., N and k = 1,..., K. In the max- 


2m »(X; |e E; ) 


z 


N 
D VikXi 
imization step, the parameter © is updated as: 2, = + Yik- By = Fy , and 
i=1 D vit 

i=1 


= vit (Xi — Me) (Xi — Ma)” 
y= = =- ,fork=1,...,K. 
È vik 
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Fig. 6.1 The basic model of Input Hidden Layers 
a fully-connected ANN, Layer Layer 
which is composed of input 
layer, output layer and 
hidden layers. The 
commonly used activation 
functions are sigmoid 
function, Tanh function and 
ReLu function 


Activation 
Function 


6.2.2 Deep Learning 


Deep learning (DL) has significantly advanced the development of computer vision 
(CV) and natural language processing (NLP) recently. As the core technique of DL, 
ANN has been used to approximate the relationship between an input and an output. 
Generally, a typical ANN is composed of three parts, namely, input layer, output 
layer and hidden layers as shown in Fig. 6.1. In each layer, many cells with differ- 
ent activation functions are placed, and the cells in adjacent layers are connected 
with each other in a pre-designed manner. With the development of ANNs, there are 
different network structures used for different types of data. For example, a convolu- 
tional neural network (CNN), which consists of convolutional layers, pooling layers 
and fully connected layers, is suitable for images; while a recurrent neural network 
(RNN), which contains many recurrent cells in the hidden layers, is suitable for time 
series data. Furthermore, in order to improve the generalization and convergence 
performance of the DL, dropout and other techniques are introduced in the design 
of neural networks [9]. 


1. Convolutional Neural Network: Convolutional neural network (CNN) is a spe- 
cial network for processing images, in which the cells adopt convolution opera- 
tions. A typical CNN is composed of multiple convolutional layers, pooling layers 
and fully-connected layers [10]. 
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a. Convolutional Layer: Different from the fully-connected layers, a convo- 
lutional layer contains a set of multiple feature maps, which are obtained by 
using different convolution kernels to operate on the input image. In particular, 
one feature map is calculated by one convolution kernel operating on the input 
image, which means all the elements in the same feature map share the same 
weight and bias with each other. Besides, the size of the convolution kernel 
is smaller than that of the input, and the CNN has the unique characteristic 
referred to as sparse interactions. 

b. Pooling Layer: A pooling layer is usually placed after a convolutional layer 
in a CNN to capture invariant features. Specifically, the pooling operation is to 
replace the output of one position in the input image with a summary statistic 
of the neighborhood. A commonly used pooling method is the max-pooling 
function, which gives the maximum output of the rectangular region. In fact, 
the pooling operation can be seen as an action to add a strong prior knowledge. 


In order to utilize the extracted feature maps, fully-connected layers are normally 
used as the last several layers of a CNN. With the help of the special structure, 
CNNSs can process data with clear mesh topology effectively. 

2. Recurrent Neural Network: Recurrent neural network (RNN) is a powerful tool 
for time series data, which have shown superior performance on speech recogni- 
tion [11]. Different from traditional neural networks, there are many connected 
cells in each layer in an RNN. All cells in the same layer have the same structure 
and each of them passes its information to its successor. The output of an RNN 
is determined by not only its current input but also the memory recorded in the 
past time steps. However, conventional RNNs cannot learn long-term dependent 
information and suffer from the gradient vanishing problem easily. Then long 
short-term memory (LSTM) network, as a kind of gated RNN network, is pro- 
posed to mitigate this problem. Specifically, in each cell of an LSTM network, 
there are three gates, namely, the input gate, the forget gate and the output gate, 
which are given as follows 


i, = o (W,h,_| + Ujx; + bi) 
£ = o(Wyhy_1 + Upx, + bp) (6.10) 
0 = o (Why 1 + Uox: + bo) 


where i;, f;, and o; are the input gate, the forget gate and the output gate, respec- 
tively; W;, U;, b;, Wr, Us, by, Wo, Uo, bo are the weight matrices and biases of 
the corresponding gate, respectively; and o(-) is the sigmoid function. Addition- 
ally, each cell has a self-loop and its cell state is jointly controlled by the forget 
gate and the input gate. Specifically, the forget gate determines what information 
to remove and the input gate determines what information to add to the next cell 
state. Mathematically, the cell state can be expressed as 


C = f, *Cy_-] + i; d tanh(W.h;,—1 + Ux; + be) (6.11) 
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Fig. 6.2 The standard DRL s( t+ 1) 
framework, in which an State 
agent selects actions by 

inputting its state to the 

neural network and executes Reward 
the action to interact with the r(s(t),a(t)) 


environment continuously 


Environment 


where W., U, and b, are the weight matrices and the bias of the cell memory, 
respectively. The gated structure allows the LSTM network to learn the long-term 
dependent information while avoiding vanishing gradients. 


6.2.3 Deep Reinforcement Learning 


As the combination of DL and RL, deep reinforcement learning (DRL) has shown 
superior performance in sequential decision-making tasks. In the DRL framework, 
as shown in Fig. 6.2, the agent inputs its observation (state) s (t) € S into the neural 
network and outputs an action a(t) € A. Then it obtains a reward R(s(t), a(t)) which 
is used to evaluate the profit of the selected action by executing it. After a period of 
learning, the agent can learn the optimal strategy, which maps an state to an action, to 
maximize its long-term accumulative reward from continuous interactions with the 
environment. Similar to RL, the basic elements of DRL are also state space S, action 
space A and the reward function R. Different from the traditional RL, which uses a 
table to indicate the relationship between the state space and the action space, DRL 
uses a neural network as the function approximator, and therefore it works more 
effectively for problems with high dimensional state and action spaces. In DRL, 
the commonly used methods are deep Q-network (DQN), double deep Q-network 
(DDQN), asynchronous advantage actor-critic (A3C) and deep deterministic policy 
gradient (DDPG). 


1. Deep Q-network: Different from the tabular method in traditional RL, a neural 
network called deep Q-network (DQN) is adopted to approximate the relation- 
ship between state space and action space [12]. Since the DQN is optimized by 
minimizing the temporal difference error, the loss function of DQN is given as 


L@)= 3| (y?2N ~ O(s,a; DH (6.12) 
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where E [-] indicates the expectation operation, Q(s, a; 0) is the Q-function with 
the parameter 6, and the target value y?2" is given as 


yo" =R(s,a)+yQ(s',a’; 0) (6.13) 


To improve the performance of the basic DQN, two other techniques, i.e., experi- 
ence replay and quasi-static target network, are introduced in the design of DQN 
technique. 


e Experience Replay: The agent needs to construct a fixed-length memory M, 
which is based on the first-in-first-out (FIFO) rule. In each training step t, the 
agent needs to store newly obtained experience into the memory M, and then 
a mini-batch d, of experiences is sampled randomly from M for training. 

e Quasi-static Target Network: The agent constructs two DQNs of the same 
structure, i.e., the target DQN Q(s, a; 6’) and the trained DQN Q(s, a; 0), 
where 0’ and 0 are their respective parameters. In every K steps, the trained 
network share its parameter with the target network. 


Additionally, in order to balance the relationship between exploration and exploita- 
tion, the €-greedy algorithm is usually adopted in a DRL. Specifically, an agent 
selects the action corresponding to the maximum Q-value of the trained network 
with a probability 1 — €, and selects an action randomly otherwise. After the 
algorithm converges, the agent just selects the action with the maximum Q-value, 
and the target network is closed. 

2. Double Deep Q-network: Since the target value is from the same DQN, the 
Q-function may be overestimated and trapped in a local optimum, leading to 
the performance degradation. To improve the performance of DQN, double deep 
Q-network (DDQN) can be adopted to provide more accurate estimation of the Q- 
function [13]. In the DDQN, the target value y??2% can be expressed as follows 


yPPON ~ R(s,a)+yvO (s. arg max Q (s’, a’; 0); a’) (6.14) 
d'EA 
After years of development, ML has become the most concerned discipline in the 
information age and shown strong effectiveness in applications. As the main force 
of AI technique, more and more ML algorithms are applied in various fields in order 
to achieve industrial intelligence. 


6.3 Machine Learning for Spectrum Sensing 


Spectrum sensing is an important task to realize DSM in wireless communication 
systems, and is usually used to assist users to find out the channel status. In order to 
increase the accuracy of spectrum sensing, many spectrum sensing algorithms have 
been developed in the past years, such as estimator-correlator (EC) detector, the semi- 
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blind energy detector and the blindly combined energy detection (BCED). Although 
the EC detector can achieve the optimal performance, it needs the knowledge of PU 
signals and noise level. The semi-blind energy detector is more practical, and it only 
requires the knowledge of the noise power. However, the performance of the semi- 
blind energy detector depends heavily on the accurate knowledge of noise power, 
which is usually uncertain. The BCED does not need any prior knowledge about the 
PU signals or noise, but the performance is worse than the performance of the semi- 
blind energy detector. It is noticed that most existing algorithms are model-driven, 
and need the prior knowledge of noise or PU signals to achieve good performance. 
However, this feature makes them unsuitable for practical environment, and the lack 
of prior knowledge would result in performance degradation. 

To solve the above issues, machine learning techniques have been adopted to 
develop cooperative spectrum sensing (CSS) framework [14]. Specifically, the work 
considers a CR network, in which multiple SUs share a frequency channel with 
multiple PUs. The channel is considered to be unavailable for SUs to access if at 
least one PU is active and it is available if there is no active PU. For cooperative 
sensing, each SU estimates the energy level of the received signals and reports it to 
another SU who acts as a fusion center. After the reports of the energy level from 
all SUs are collected, the fusion center makes the final classification of the channel 
availability. 

Using the machine learning technique such as K-means algorithm, GMM cluster- 
ing, SVM algorithm and KNN algorithm, the fusion center can construct a classifier 
to detect the channel availability. With unsupervised machine learning such as K- 
means and GMM clustering, the detection of the channel availability relies on the 
cluster that the sensing reports from all the SUs are mapped to. On the other hand, 
with supervised machine learning such as SVM algorithm and KNN algorithm, the 
classifier is first trained using the labeled sensing reports from all SUs. After the clas- 
sifier is trained, it can be directly used to derive the channel availability. Compared 
with traditional CSS techniques, the proposed machine learning framework can bring 
the following two advantages: (1) it is robust to the changes in the radio environment; 
(2) it can achieve a better performance in terms of classification accuracy. 


6.4 Machine Learning for Signal Classification 


Signal classification, usually performed before signal detection, is a fundamen- 
tal task in cognitive radio networks. Consider the modulation classification as an 
example. Traditionally, there are two kinds of modulation classification approaches, 
namely, the likelihood-based (LB) approach and the feature-based (FB) approach. 
The LB approach is based on computing the likelihood function of received sig- 
nals under different modulation schemes hypotheses, and the modulation scheme 
with the maximum likelihood value is validated. With perfect knowledge of channel 
and noise parameters, the LB approach can achieve the optimal performance in a 
Bayesian sense. However, the estimation of these parameters imposes high compu- 
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tation complexity. In the FB approach, useful features such as higher-order statistics 
are extracted for decision-making. In general, the FB approach has lower compu- 
tational complexity but it can only achieve sub-optimal performance. Therefore, in 
order to achieve near optimal performance with low computational complexity, ML 
techniques have been introduced in solving the modulation classification problem, 
and have shown superior performance recently. 


6.4.1 Modulation-Constrained Clustering Approach 


In [15], a clustering-based LB classifier is proposed for modulation classification in 
multiple-input and multiple-output (MIMO) communication systems. In that work, a 
spatial-multiplexed MIMO system with N, transmit antennas and N, receive anten- 
nas is considered, in which data symbols are transmitted independently from each 
transmit antenna. The signal model of the n-th received signal vector y (n) is given 
as 

y(n) =Us(n)+u(n), n=1,...,N (6.15) 


where H e C%**: is the channel matrix which remains constant within each block 
of N symbols, and u (n) denotes the AWGN vector. 

For LB classifiers, the classification decision is made by selecting the modulation 
scheme with the maximum likelihood 


M= arg max Ly (6.16) 
MEM 


where Ly is the likelihood function corresponding to the modulation scheme M and 
M is the set of candidate modulation schemes. 

Since the noise at the receiver is Gaussian, the PDF of the received signals fol- 
lows the GMM given in (6.7) where K = Q™, the mean and the Covariance matrix 
of the k-th Gaussian component are given as a, = Hs(n) and £; = o°7I, respec- 
tively. The likelihood function for each modulation scheme can be calculated by 
estimating the parameters of the GMM model using the EM algorithm introduced in 
Sect. 6.2.1. However, the direct application of the EM algorithm presents the follow- 
ing challenges. Firstly, the modulation order Q of a modulation scheme determines 
the number of Gaussian components as well as the number of parameters to be esti- 
mated in the GMM model. Thus, the computational complexity for calculating the 
likelihood function of a higher-order modulation scheme can be extremely high. 
Secondly, the initialization of the set of parameters is an important part in the EM 
algorithm, and it would influence the converged performance and the convergence 
speed of the algorithm significantly. Hence, in order to improve the performance of 
the EM algorithm for modulation classification, there is a need to propose an EM 
algorithm with less parameters to be estimated and a good initialization method. 
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To reduce the number of parameters, a centroid reconstruction method is proposed 
in [15] by exploiting the relationship among the constellations. With the help of the 
proposed centroid reconstruction method, the number of parameters to be estimated 
is reduced from Q™ to N, only. This also reduces the number of signal samples 
needed for the estimation. Specifically, for multiple-input and single-output (MISO) 


channels, the cluster centroids y = [{41, H2, ..., ug ] can be reconstructed as follows 
u= YA (6.17) 
where A = [aj, a,..., ay, |? is the reconstructive coefficient matrix, which is a 


known constant matrix for each modulation scheme, and W = [7,..., ry,] is the 
corresponding reconstructive parameter vector. 

By introducing constellation-structure-based centroid reconstruction in the EM 
algorithm, the iteration of { Ly Ka can be replaced by the iteration of r1, r2,..., FN,- 


If we denote ® = fri, F2, -e23 FNs 51} as the set of the unknown parameters, the 
likelihood function is shown as 


N K 1 
L= on (>: a) (6.18) 


n=1 k=1 


Hence, the proposed EM algorithm for modulation classification is shown as below. 


1. Initialization: A two-stage initialization is proposed. In the first stage, fuzzy 
estimation is introduced to transform the parameters into a smaller range. In 
the second stage, modulation constrained K-means (MC K-means) algorithm 
is adopted, in which the constellation structure and the centroid reconstruction 
method are utilized. 

2. E-step: Calculate the latent variable 


Ply) |® 
Ynk = = ( (6.19) 
Dm- p(y) la) 
k=1 
and then the reconstructive parameters 
N 
E D vaag (y (2) — akr — +++ — an, kN, ) 
he n=1k=1 (6.20) 


Yak (a) 


Me 
Mar 


n=1k=1 
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N K 
» » Ynk ink (y (n) — aiki S> an,,kTN,) 
n=1k=1 
Fm = N K (6.21) 
» 2 Yak (amx) 
n=1k=1 
where m = 2,..., Ni. 


3. M-step: The cluster centroids yw and the noise variance o are updated iteratively 
as below 
My = ayer) + azr +--+ + an, ery, k = 1,...,K (6.22) 


and 


N K H 
E DY ynk (y) — wy) (y 0) = u) 
eee (6.23) 


where k = 1,..., K. 

4. Classification Decision: Repeat Step 2 and Step 3 iteratively until the likelihood 
function is converged. Then make the classification decision according to the 
criterion defined in (6.16). 


Simulation results in [15] show that the proposed algorithm performs well with 
short observation length in terms of classification accuracy. Additionally, the perfor- 
mance achieved by the proposed algorithm is close to that of the average likelihood 
ratio-test upper bound (ALRT-UB), which can be seen as the performance upper 
bound of any modulation classification algorithm. 


6.4.2 Deep Learning Approach 


The modulation classifier in Sect. 6.4.1 requires accurate knowledge of the channel 
model. In addition, the channel model may not be available in practice. As a powerful 
supervised learning framework, DL can also be applied in modulation classification. 
In [16], a low-complexity blind data-driven modulation classifier based on DNN is 
proposed, which operates under uncertain noise condition modeled by a mixture of 
white Gaussian noise, white non-Gaussian noise and time-correlated non-Gaussian 
noise. 

In [16], a single-input and single-output (SISO) channel is considered, and the 
n-th received signal sample is given as 


r(n)=hs(n)+u(n),n=1,2,..., N (6.24) 
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where s (n) is the transmitted symbol from an unknown modulation scheme M;, N 
is the number of symbols in a block, h is the channel coefficient and u (n) denotes 
the additive noise. 

Denote the set of the candidate modulation schemes and the received signal 
sequence by M = {M;, i =1,2,..., L} and r=[r(1),r(2),...,r(M)], respec- 
tively. Let P(M;|r) denote the a posterior probability of the modulation scheme 
M; given the received signal r. The objective of the work is to find the modulation 
scheme which maximizes the a posterior probability. This is known as the maximum 
a posterior (MAP) criterion. 


M; = arg max P(M;|r) (6.25) 
MieM 


In order to accurately make classification decisions with low complexity, the 
DNN is adopted to learn the a posterior probability P(Mj|r), i= 1,..., L. The 
DNN is used as an approximation function f mapping the received signal to the a 
posterior probability. The in-phase and quadrature (IQ) components of the received 
signal samples are chosen as the inputs to the proposed neural network. Motivated 
by its superior performance for processing time-dependent data, the long short- 
term memory (LSTM) network is introduced in the design of the proposed neural 
network. There are three main reasons that the LSTM network is suitable for solving 
a modulation classification problem. 


1. The LSTM network is able to learn features effectively from highly time- 
dependent data. This indicates the neural network with LSTM layer have advan- 
tages in learning the a posterior probability from the signal samples which are 
highly time-dependent over time-correlated non-Gaussian channels. 

2. Different from the fully-connected network which can only receive a one- 
dimensional as input, LSTM network allows two-dimensional vectors as the input 
in each time step. Hence, the network can process complex signal samples com- 
posed of IQ components, and can learn better from the input data. 

3. Compared to the conventional fully-connected network, there are fewer parame- 
ters in the LSTM network because all time steps share the same weight matrices 
and biases. 


Additionally, in order to summarize the output form the LSTM network, a tempo- 
ral attention mechanism is adopted in the final LSTM layer over the outputs from all 
time steps. In the temporal attention mechanism, each output has a different weight, 
which indicates the importance of each to the modulation classification results. 

Specifically, the proposed seven layer-neural network is composed of three 
stacked-LSTM layers and four fully-connected layers. In the training phase, the 
one-hot coding vectors of true modulation schemes of the input signal samples are 
used as the labels. The Adaptive Moment Estimation (Adam) optimizer is used to 
minimize the loss function to optimize the weights and bias in the network. After the 
training phase, the modulation classification is made by according to the MAP cri- 
terion defined in (6.25). The simulation results show that the classification accuracy 
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of the proposed classifier approaches that of the ML classifier with all the chan- 
nel and noise parameters known. Moreover, under uncertain noise conditions, with 
lower computational online complexity, the proposed classifier can achieve a better 
performance than the EM and ECM classifiers. 


6.5 Deep Reinforcement Learning for Dynamic Spectrum 
Access 


In traditional DSA mechanism, there exists a centralized control node responsible 
for allocating the spectrum resources to users. Before making the access decisions, 
the centralized node needs to collect the global network information, such as the 
position information of users and base stations as well as the channel state infor- 
mation. However, such global network information is difficult to obtain in practice, 
as it imposes significant signal overheads on the system especially when there is a 
large number of users. Additionally, the collected information may be outdated in a 
highly dynamic network environment, resulting in invalid access strategy and poor 
performance. To solve the above issues, intelligent DSA framework operating with 
local network information is desirable. Recently, researchers introduced DRL tech- 
niques for DSA, showing superior performance on sequential decision-making tasks, 
to enable more flexible and intelligent DSA mechanism [17]. Since agents in DRL 
can make full use of the representation ability of neural networks, the decision space 
can be high-dimensional and continuous, which can guarantee the performance of 
the DSA mechanisms for large-scale networks. 

In the following sections, we will introduce several typical applications on the 
use of DRL techniques for DSA. 


6.5.1 Deep Multi-user Reinforcement Learning for 
Distributed Dynamic Spectrum Access 


In [18], a DRL-based DSA framework is proposed to manage dynamic spectrum 
access in multichannel wireless networks, in which each user acts as an agent to 
make channel access decisions intelligently and independently to maximize its long- 
term transmission rate. 

In this work, a wireless network composed of N users and K shared orthogonal 
channels is considered. Denote the set of users and the set of channels as N = 
{1,2,..., N}andK = {1,2,..., K}, respectively. It is assumed that each user needs 
to choose a single channel for transmission in each time slot, and it always has packets 
to transmit. Additionally, the transmission is successful if there is only one user 
accessing the channel, and the transmission fails otherwise. After each transmission, 
each user can receive a binary observation o, (t) to indicate whether its transmission 
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is successful or not, i.e., 0, (t) = 1 if the transmission is successful and o,(t) = 0 
otherwise. 

With the assumption that users don’t have message exchange in each time slot, 
they can only make access decisions by their local observations. In order solve the 
above problem, a DRL-based distributed framework for DSA is proposed, in which 
each user acts as an agent and constructs a DQN. The action space, state space and 
reward function are described as follows. 


1. Action Space: In each time slot, each user needs to choose whether to transmit or 
not. If the user chooses to transmit, it needs to select a channel for transmission. 
The action of user n in time slot ¢ is given as 


a,(t) € {0,1,..., K} (6.26) 


where a, (t) = 0 indicates that user n chooses not to transmit in time slot t. 
2. State Space: The state of each user is composed of its action and observation 
up to time slot t, which is given as 


Hy (t) = (fan DYZ > {on OHI) (6.27) 


3. Reward Function: Since the objective is to maximize the long-term rate, the 
function of achievable rate is chosen as the reward function 


T(t) = B log, (1 + SNR, (k)) (6.28) 


where B is the channel bandwidth and SN R,,(k) is SNR of user n on channel k. 


In the DRL-based framework proposed in [18], in order to capture features from 
observations, the LSTM network is introduced in the structure of the adopted DQN. 
Additionally, the DDQN method is also adopted to improve the performance of the 
DQN. In the training phase, each user trains the parameters of their respective DQN 
cooperatively by communicating with a central unit. After updating the parameters, 
each user uses the trained DQN to make access decisions autonomously and inde- 
pendently. After the DQN is well-trained, the central unit is closed, and users use the 
converged DQN to obtain efficient access policy directly. 


6.5.2 Deep Reinforcement Learning for Joint User 
Association and Resource Allocation 


In heterogeneous networks (HetNets), all the base stations (BSs) normally provide 
services to users on shared spectrum bands in order to improve the spectrum effi- 
ciency. However, most existing methods need accurate global network information, 
e.g., channel state information, as the prior knowledge, which is difficult to obtain 
in practice. 
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In [19], a distributed DRL-based DSA framework is proposed for user association 
and resource allocation in the downlink HetNets. Specifically, a three-tier heteroge- 
neous network is considered, which consists of N,,, macrocell base stations (MBSs), 
N, pico base stations (PBSs), Ny femto base stations (FBSs) and N user equip- 
ments (UEs). The sets of UEs and BSs are denoted, respectively, by N = {1,..., N} 
and 8 = {0,1,..., L — 1}, where L = Nm + N, + Ny. All the BSs share the same 
K orthogonal channels for downlink transmission, and the set of channels can be 
denoted as K = {1,..., K}. 

For each UE i, denote b! (t) = (b? (t),... be O) i € N, l € Bas the binary 
user-association vector, where b! (t) = 1 if UE i is associated with the BS; at time t 
and b! (t) = 0 otherwise. For each BS, a binary channel-allocation vector is defined 
as c (t)= (cl (t),.. oe (t)), i € N,k € K, where c! (t) = 1 if UE i uses channel 
resource Cz at time t and c! (t) = 0 otherwise. It is assumed that each UE can only 
be connected to one BS and each channel can only be allocated to one UE for each 
BS in each time slot t. 

The transmission power between UE i and its associated BS / on channel Cx at 
time ź can be denoted as pi, (t)= (Pi; Mares pÉ (t)) Ee Bie N,k € K. Since 
all the BSs share the common spectrum resource, the co-channel interference should 
be considered. Hence, the signal-to-interference-plus-noise-ratio (SINR) of UE i 
associated with BS / and allocated with channel Cx is given as 


bl ay hk a) ck @) pk) 


k = 
Ti (t) 7 J i,k k k 
2 jeanbi Eh; (t) c; (t) Pji (t) + WNo 


(6.29) 


where nye (t) is the channel gain between the UE i and BS / at time t, W is the 
bandwidth of each channel and Nọ is the noise spectral power. Therefore, the total 
achievable transmission rate of UE i at time ¢t can be expressed as 


L-1 K 
ri (t) = >> AY Wlog, (1+ Ti; 0) (6.30) 
1=0 k=1 


Considering that the operation cost of the UE i from BS Z is determined by the 
transmit power a (t), the total operation cost of UE i is given as 


L-1 L-1 K 
eG H= SP O= DAO 4 O PEO (6.31) 
1=0 1=0 k=1 


where A, is the price per unit of transmit power from BS /. Then we define the utility 
function of UE i as the total achievable profit minus the operation cost, which is 
denoted as 


wi (t) = pi Œ) ri (£) — gO (6.32) 


where p; > 0 is the profit per unit transmission rate. 
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In this work, the objective of each UE is to maximize its own long-term utility. 
Since the problem is an integer programming problem and the objective of the prob- 
lem is long-term, it is difficult to adopt the traditional optimization algorithms such 
as convex optimization to solve it. Additionally, the dimension of the decision space 
increases exponentially. Hence, a distributed DRL-based multi-agent framework for 
user association and resource allocation is proposed to maximize the long-term util- 
ity. 

The state space, action space and reward function for modeling such a problem 
are given as follows. 


1. State Space: In each time slot, the state is composed of the QoS of all the UEs, 
and we have 


s (t) = {s1 (t), s2 (t),..., sn (t)} (6.33) 


where s; (t) is a binary index indicating that whether UE i’s QoS is larger than the 
minimum threshold Q; or not, i.e., if the UE i’s QoS is larger than Q;, s; (t) = 1 
and otherwise, s; (t) = 0. 

2. Action Space: In each time ft, each UE needs to choose a BS and a channel to 
access. Hence, the action of UE i consists of two parts, i,e, the user-association 
vector and the resource-allocation vector 


aj; (t) = {bi 0), cf O) (6.34) 


where b! (t) € {0, 1} and ck (t) € {0, 1}. 

3. Reward Function: The reward function of UE i is mainly determined by its 
achievable rate in time slot t. Besides, to improve the convergence performance 
of the algorithm, the action-selection cost is also considered in the design of the 
reward function. 


ay J aM, TiO 2 Qi 

BAO | —W,;, otherwise (6.35) 
E EN 

where T; = >> X} T” is SINR of UE i, Q; is a pre-designed minimum QoS 
1=0 k=l 


requirement and W,; is the action-selection cost, which is a positive value. 


In the proposed framework, each UE is equipped with a DQN to make access 
decisions independently. In the initialization stage, each UE is first connected to the 
BS which resulted in the maximum received signal reference power (RSRP) and 
constructs a DQN, in which the parameter is initialized randomly. At each training 
time t, each UE has a common state s and selects an action, namely, access request, 
according to its Q-value Q; (s, a;,0) obtained from its DDQN. The access request 
contains the indices of the required BS and the channel. Then, if the BS accepts 
the request, the BS would send a feedback signal to the UE, which indicates the 
resource is available, and otherwise, the BS would not reply. After connecting to the 
chosen BS and accessing the chosen channel, the UE obtains an immediate reward 
ui (s, aj) and a new state s’, then stores the current experience (s, aj, Ui (Ss, ai), s’) 
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into its replay memory D. Finally, each UE updates the parameter 6 of its DDQN by 
using stochastic gradient descent (SGD) algorithms based on the random samples 
from the memory D. 


6.6 Summary 


In this chapter, we have provided a brief review on machine learning techniques, and 
have described some applications on AI-based DSM mechanisms such as spectrum 
sensing, signal classification and dynamic spectrum access. These AI-based DSM 
mechanism have been shown to achieve better performance and robustness than 
conventional schemes. Additionally, they can also provide more efficient and flexible 
ways to implement the DSM. In the future, the combination of AI techniques and 
the DSM mechanisms would become a novel and promising research direction. 
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